-- Logs begin at Fri 2022-10-28 08:59:37 UTC, end at Fri 2022-10-28 10:03:19 UTC. -- Oct 28 09:30:57.482731 dv-osbrick-zed-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 09:30:57.500293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:30:57 2022] *** Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: nodename: dv-osbrick-zed-4-iscsi Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: machine: x86_64 Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: clock source: unix Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: pcre jit disabled Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: detected number of CPU cores: 4 Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: current working directory: / Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: your processes number limit is 47680 Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: your memory page size is 4096 bytes Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: detected max file descriptor number: 2048 Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: lock engine: pthread robust mutexes Oct 28 09:30:57.501092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: thunder lock: enabled Oct 28 09:30:57.503371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 09:30:57.503371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:30:57.574336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: Python main interpreter initialized at 0x55b94e83b9c0 Oct 28 09:30:57.574336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: python threads support enabled Oct 28 09:30:57.574336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: your server socket listen backlog is limited to 100 connections Oct 28 09:30:57.574336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:30:57.574880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:30:57.575043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: *** Operational MODE: preforking *** Oct 28 09:30:57.575560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:30:57.575560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: spawned uWSGI master process (pid: 88067) Oct 28 09:30:57.575821 dv-osbrick-zed-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 28 09:30:57.577661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: spawned uWSGI worker 1 (pid: 88073, cores: 1) Oct 28 09:30:57.577661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: spawned uWSGI worker 2 (pid: 88074, cores: 1) Oct 28 09:30:57.577661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88067]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:31:02.082537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:31:02.082537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: from cryptography.utils import int_from_bytes Oct 28 09:31:02.083469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:31:02.083469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: from cryptography.utils import int_from_bytes Oct 28 09:31:02.136012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:31:02.136225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:31:02.136424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] command line args: [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:31:02.136695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:31:02.136872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ================================================================================ {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:31:02.137129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] admin_token = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.137378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] config_dir = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.137565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.137748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] config_source = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.137928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] debug = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.138129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.138523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.138699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.138962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.139211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.139444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.139625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_config_append = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.139790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.139972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_dir = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.140148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_file = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.140423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.140686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.140930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.141183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.141364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.141536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.142302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.142547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.142791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.143026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.143261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.143595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.143852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.144099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.144408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.144925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.145114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] publish_errors = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.145355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.145593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.145775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.146028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.146267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.146507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] standard_threads = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.146742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.146990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.147170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.147348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] use_journal = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.147525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] use_json = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.147700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] use_stderr = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.147879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] use_syslog = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.148114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.148402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.148644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.148908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.149148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.149398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.149642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.149892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.150133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.150386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.150635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.150890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.151126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.151374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.151615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.151863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.152113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.152376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.152640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.152896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.153143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.153383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.153639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.153909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.154162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.154412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.154651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.154884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.155117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.155353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.155604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.155850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.156083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.156342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.156590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.156838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.157078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.157504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.157878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.158182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.158495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.158671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.158899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.159133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.159363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.159610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.159861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.160092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.160395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.160626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.160862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.161103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.161352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.161585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.161826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.162064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.162301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.162545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.162783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.163013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.163265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.163504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.163744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.163977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.164289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.164502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.164743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.164981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.165218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.165498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.165741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.165993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.166246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.166742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.166981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.167218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.167468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.167706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.167945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.168191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.168460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.168710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.168949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.169186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.169424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.169658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.169894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.170166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.170412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.170661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.170905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.171146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.171391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.171630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.171869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.172107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.172373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.172610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.173362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.173616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.173851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.174095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.174371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.174625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.174867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.175128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.175393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.175637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.175871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.external = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.176103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.176429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.176664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.176897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.password = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.177128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] auth.token = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.177371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.177610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.177859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.178090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.178339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.178587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.178824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.179061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.179308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.179561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.179811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.180057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.180326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.180566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.180814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.181070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.181419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.181634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.181844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.182090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.182370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.182599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.182862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.183103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.183335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.183586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.183831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.184064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.184339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.184580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.184837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.185071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.185327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.185564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.185812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.186048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.186296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.186542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.186780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.187015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.187262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.187494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.187730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.187978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.188231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.188588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.188789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.189022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.189268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.189529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.189774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.190024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.190272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.190532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.190770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.191010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.191225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.191464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.191694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.191931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.192178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.192492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.192680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.192922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.193169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.193419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.193653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.193901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.194150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.194379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.194617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.194848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.195086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.195322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.195565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.195804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.196197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.196483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.196735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.197089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.197254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.197447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.197693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.197937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.198175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.198416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.198646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.198891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.199152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.199385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.199882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.200129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.200393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.200627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.200862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.201099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.201338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.201569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.201819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.202065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.202311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.202560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.202809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.203045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.203294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.203533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.203769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.204006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.204786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.205035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.205284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.205524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.205780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.206010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.206258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.206496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.206733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.206972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.207218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.207460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.207692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.207930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.208172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.208450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.208698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.208934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.209184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.209436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.209673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.209918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.210155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.210393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.210628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] role.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.210877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] role.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.211106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.211356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.211610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.211853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.212100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.212371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.212620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.212864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.213114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.213348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.213596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.213842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.214089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.214334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.214796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.215010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.215259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.215508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.215755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.216010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.216326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.216538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.216790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.217028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.217263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.217495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.217725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.217978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.218153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:31:02.218153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: from cryptography.utils import int_from_bytes Oct 28 09:31:02.218754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.218754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.218963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:31:02.218963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: from cryptography.utils import int_from_bytes Oct 28 09:31:02.219179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.219179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.219179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.219486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.219607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.219869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.220113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.220403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.220654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.220894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.221140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.221387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.221633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.221870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.222109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.222347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.222593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.222869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.223101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.223347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.223618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.223880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.connection = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.224127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.224399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.224638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.224882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.225119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.225357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.225595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.225834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.226079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.226318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.226563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.226800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.227048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.227284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.227531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.227762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.228004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.228254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.228433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:31:02.260463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.260682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.260896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.268926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:31:02.269150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:31:02.269422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] command line args: [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:31:02.269751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:31:02.269979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ================================================================================ {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:31:02.270244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] admin_token = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.270470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.270605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] config_dir = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.270718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.270830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] config_source = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.271003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] debug = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.271220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.271457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.271635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.271888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.272133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.272389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.272567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_config_append = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.272744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.272921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_dir = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.273097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_file = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.273332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.273578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.273822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.274068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.274252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.274407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.274648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.274894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.275125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.275357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.275588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.275817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.276062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.276347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.276627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.277135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.277318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] publish_errors = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.277551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.277779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.277955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.278199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.278431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.278664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] standard_threads = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.278893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.279132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.279308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.279482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] use_journal = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.279656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] use_json = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.279829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] use_stderr = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.280008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] use_syslog = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.280234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:31:02.280520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.280756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.281013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.281251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.281498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.281734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.281981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.282246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.282564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.282977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.283449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.283779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.284026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.284290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.284542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.284790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.285170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.285481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.285777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.286027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.286262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.286514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.286792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.287045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.287293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.287524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.288209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.288529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.288857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.289100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.289349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.289580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.289811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.290055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.290301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.290538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.290785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.291017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.291252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.291740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.291969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.292197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.292458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.292685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.292919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.293165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.293393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.293627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.293855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.294088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.294323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.294570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.294832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.295158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.295474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.295731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.295966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.296210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.296560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.296902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.297146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.297385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.297618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.298416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.298648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.299060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.299502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.299824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.300105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.300378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.300634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.300886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.301127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.301376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.301564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.301683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.301801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.301919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.302074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.302311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.302555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.302791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.303037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.303273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.303508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.303741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.303975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.304210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.304502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.304744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.304991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.305241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.305477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.305717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.305953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.306187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.306419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.306648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.306878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.307106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.307341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.307569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.307810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.308041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.308319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.308558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.308814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.309073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.309313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.309541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.external = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.309770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.310062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.310291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.310521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.password = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.310748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] auth.token = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.310987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.311221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.311465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.311693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.311937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.312180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.312437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.312671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.312917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.313163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.313408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.314186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.314436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.314731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.314980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.315234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.315470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.315731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.316015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.316315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.316553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.316794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.317053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.317287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.317523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.317767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.318014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.318244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.318490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.318726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.318979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.319213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.319465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.319709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.319958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.320195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.320473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.320721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.320957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.321191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.321438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.321665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.321900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.322145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.322396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.322625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.322855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.323083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.323327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.323570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.323814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.324064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.324335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.324607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.324844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.325079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.325307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.325545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.325773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.326005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.326246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.326482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.326727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.326957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.327200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.327443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.327674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.327917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.328159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.328415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.328650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.328890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.329182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.329421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.329806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.330242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.330603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.330860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.331109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.331343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.331574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.331951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.332199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.332465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.332747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.332936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.333169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.333412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.333673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.333906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.334152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.334400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.334645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.334880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.335109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.335344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.335581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.335815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.336045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.336316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.336562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.336881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.337127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.337441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.337849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.338289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.338721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.339148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.339580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.340018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.340512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.340993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.341445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.341928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.342376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.342850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.343297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.343744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.344207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.345251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.345717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.346160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.346613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.347083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.347548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.348005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.348481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.348963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.349438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.349888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.350368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.350816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.351280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.351728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] role.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.352204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] role.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.352715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.353175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.353654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.354131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.354597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.355051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.355441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.355707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.355974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.356411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.356848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.357114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.357371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.357626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.358075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.358321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.358574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.358828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.359079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.359335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.359571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.359832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.360083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.360406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.360701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.360875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.361090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.361527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.361801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.362119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.362311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.362697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.363128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.363534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.363961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.364427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.364886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.365328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.366184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.366184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.366443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.366635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.366938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.367262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.367561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.367851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.368138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.368467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.368806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.369085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.369379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.369693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.370000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.connection = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.370305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.370602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.370887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.371179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.371461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.371745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.372028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.372363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.372661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.372948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.373241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.373527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.373822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.374105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.374399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.374704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.374993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.375274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:31:02.375488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:31:02.405948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.406295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.406413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.414112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.414331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.416789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.438236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.439019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.482003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.523435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.523669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.577521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.577756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.577896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.578935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.579067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.603859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.604055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.604179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.604417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.604640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.604756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.604887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.605939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.617862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.632319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.632573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.632796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.633018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.633236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.633450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.633666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88073) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.652005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.652229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:31:02.652593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.652796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:31:02.653079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.653348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.653612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.653876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.664701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.665005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.665283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.665572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.673431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.676893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.677205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.677498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.677790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.678081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.678350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.678625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.678908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.679188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.679470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.679746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.703193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.705525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.705818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.709478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.710663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.710991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.711258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.712592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.712823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.713047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.713268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.713482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.713694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.713902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88074) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:31:02.717811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.718120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.724279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.724610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.724731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.724860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:31:02.724982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.725174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.725307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.725427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:31:02.725553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.725675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.725797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.725930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.726056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.726178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.726299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.726419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.737124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.737390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.737624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.737912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.742703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.743010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.745100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.747031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.748063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.748384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.748674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.748959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.749245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.749673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.749832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.750079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.750378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.750563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.750746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.751338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.751338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.755109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.758331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.761867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.762188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.762478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.762768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.763061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.763366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.775994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.777654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.777944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.780162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.780500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.780775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.781044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.783065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.783588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.783880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.788488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.790088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.790417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.790728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.791906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.792199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.795005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.795241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.795362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.795549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.795696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.795821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.795948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.796103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.796275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.796414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.796667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.796939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.797210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.808309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.808629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.808916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.809202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.809602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.809902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.810204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.814483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.814818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.818880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.822483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.822795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.825935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.827068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.828947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.831118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.832436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.833900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.834422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.834730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.835018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.835305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.835476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.835657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.835777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.835955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.836186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.842796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.844376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.847432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.847854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.848145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.848454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.854954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.855235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.855438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.855700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.856447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.856764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.857054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.863782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.864783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88073) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.865096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.865382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.865559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.865744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.865931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.866215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.866492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.866776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.866928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.867081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.867232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.867395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.867596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.867869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.868139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.868450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88073) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.869888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.870185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.870590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.870886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.871187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.883509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.883821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.884198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.884513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.884801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.885092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.885381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.903810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b94e83b9c0 pid: 88073 (default app) Oct 28 09:31:02.904963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.907510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d19c-37bd-43ad-818f-d59b2b82f1d1 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:02.907800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d19c-37bd-43ad-818f-d59b2b82f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:02.908077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d19c-37bd-43ad-818f-d59b2b82f1d1 None None] PATH_INFO: `/v3` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:02.908359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.909913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.911553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.911842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.912126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.912420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Fri Oct 28 09:31:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:02.918960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.920515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.924553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.924954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.925242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.925670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.935778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.936147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.936532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.946482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88074) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:31:02.946957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.947408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.947804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.948202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.948603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.948965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.949337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.949701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.950097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.950485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.950864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.951238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.951597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88074) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:31:02.991544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b94e83b9c0 pid: 88074 (default app) Oct 28 09:31:10.841655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:10.842485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:10.842485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:10.843551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:10.852960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:10.853707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:10.853707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:10.930839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: INFO dbcounter [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] Registered counter for database keystone Oct 28 09:31:10.954288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:31:10.963637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writer thread running {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:31:11.166149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG passlib.handlers.bcrypt [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88074) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 09:31:11.166478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG passlib.handlers.bcrypt [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88074) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 09:31:11.237862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:11.239609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:11.405161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 1/3] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 09:31:11.899541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:11.971502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: INFO dbcounter [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] Registered counter for database keystone Oct 28 09:31:11.994755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG oslo_db.sqlalchemy.engines [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:31:12.006269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writer thread running {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:31:12.257024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3449-aba3-484c-a91f-69829c6f0d09 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:12.264516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:12.265620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:12.266291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:12.266784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:12.285446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:12.392508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 09:31:12.392985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f854aba-f455-4ac0-8f7d-4948a3d05bb7 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:12.411750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1324 bytes} [Fri Oct 28 09:31:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:31:12.419370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:12.447414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2843d8-7448-4a56-bfb8-40a6b471222c None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:12.455690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:12.457736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:12.458222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:12.458701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] PATH_INFO: `/v3/projects/4a3fbfe9961948fb97255019ee76e43a` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:12.461520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] RBAC: Authorizing `identity:get_project(project_id=4a3fbfe9961948fb97255019ee76e43a)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:12.566327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING keystone.common.rbac_enforcer.enforcer [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 09:31:12.566816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b36d21-aa23-49f9-9826-c0a2576dd89d admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:12.577331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 2/5] 10.222.0.44 () {56 vars in 1207 bytes} [Fri Oct 28 09:31:12 2022] GET /identity/v3/projects/4a3fbfe9961948fb97255019ee76e43a => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:14.849136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd9613-4501-4b5c-a537-c814d7bebff5 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:14.849713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd9613-4501-4b5c-a537-c814d7bebff5 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:14.849713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd9613-4501-4b5c-a537-c814d7bebff5 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:14.853966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 4/6] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:14.861799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:14.862360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:14.862484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:14.885446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:14.887026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:14.896232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 09:31:15.176957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd9613-4501-4b5c-a537-c814d7bebff5 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:15.190170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd9613-4501-4b5c-a537-c814d7bebff5 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:15.194687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a62c1-3a11-4cb1-bf71-bf334a678d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:15.195323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a62c1-3a11-4cb1-bf71-bf334a678d9d admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:15.195605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a62c1-3a11-4cb1-bf71-bf334a678d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:15.195882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a62c1-3a11-4cb1-bf71-bf334a678d9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:15.204885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a62c1-3a11-4cb1-bf71-bf334a678d9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:15.206716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a62c1-3a11-4cb1-bf71-bf334a678d9d admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:15.216985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1324 bytes} [Fri Oct 28 09:31:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:31:15.224394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:15.234499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ecf4-1d7a-4ec8-a628-a7ae6d8aeae1 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:15.239625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2259-09df-4862-ac47-6c8f0a679978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:15.240340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2259-09df-4862-ac47-6c8f0a679978 admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:15.240664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2259-09df-4862-ac47-6c8f0a679978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:15.240935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2259-09df-4862-ac47-6c8f0a679978 admin admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:15.242373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2259-09df-4862-ac47-6c8f0a679978 admin admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:15.244303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2259-09df-4862-ac47-6c8f0a679978 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:15.245965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 4/9] 10.222.0.44 () {56 vars in 1198 bytes} [Fri Oct 28 09:31:15 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:17.657665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57080cd3-2fbd-4d0f-b6ab-e1bab90ad65c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:17.658429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57080cd3-2fbd-4d0f-b6ab-e1bab90ad65c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:17.658429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57080cd3-2fbd-4d0f-b6ab-e1bab90ad65c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:17.659456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:17.666687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:17.667241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:17.667695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:17.675000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e611810-4e89-4fec-aaf1-bc7dd1a7f488 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:17.675270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e611810-4e89-4fec-aaf1-bc7dd1a7f488 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:17.675539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e611810-4e89-4fec-aaf1-bc7dd1a7f488 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:17.676981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 7/11] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:17.683134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:17.683546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:17.683917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:17.699502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:17.700896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:17.741254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG passlib.handlers.bcrypt [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88073) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 09:31:17.741787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG passlib.handlers.bcrypt [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88073) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 09:31:17.792516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:17.794215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:17.806375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 5/12] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:17.920964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 8/13] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:31:18.098191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.128419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:18.197736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.245858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5a849-6c16-40f1-953d-e87ec5d99588 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:18.286990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:18.287634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:18.287915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:18.288186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:18.353681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406f9c5-1075-40be-bf1b-ec1c86df3175 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:18.356542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:18.405899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:18.408620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:18.409050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:18.410316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:18.410692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:18.411064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:18.426952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:18.438115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:18.440222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:18.442125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 9/14] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:31:18.445680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.448761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:18.558118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 6/15] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:18.564551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.585737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762dd83-7ade-43aa-a206-f050bb3e9f35 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:18.624602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:18.625547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:18.625883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:18.626185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:18.626981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:18.627297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:18.628920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:18.643149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 10/16] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:18.649074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.682753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:18.686965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6171-e0ca-4856-a9d9-ce43480603c7 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:18.714324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:18.730251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:18.731098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:18.731484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:18.731969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:18.745042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:18.746672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:31:18.767490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:18.768768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:31:18.769743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:31:18.769743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:31:18.769743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:18.769743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 7/17] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:18.769992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfab2cd-16c2-418c-8ee4-499d76c531b4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:18.774939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.809956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:18.810607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:18.810882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:18.811152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:18.813192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:18.814845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:18.816951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 11/18] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:18.822664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:18.901472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4dfb-2081-4420-b258-87598b191a96 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:18.940321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:18.941142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:18.941426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:18.941701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:18.942374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:18.942679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:18.944116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:18.964149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 8/19] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:18.967459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:18.976161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bd8ca-d500-4e15-971c-e59250210543 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:19.015678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1a49f-67ee-407b-850e-2e6a05bb12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:19.016381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1a49f-67ee-407b-850e-2e6a05bb12c8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:19.016671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1a49f-67ee-407b-850e-2e6a05bb12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:19.016937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1a49f-67ee-407b-850e-2e6a05bb12c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:19.018226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1a49f-67ee-407b-850e-2e6a05bb12c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:19.019754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1a49f-67ee-407b-850e-2e6a05bb12c8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:19.021498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 12/20] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:19.027970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:19.070899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:19.151263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca243f-05a4-4522-80b0-08eb74c6d260 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:19.192407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:19.193057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:19.193340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:19.193618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:19.194374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.domain.id=default, user.id=094fba2382e149f9b3e5ba2c3c144f8d) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:19.194692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:19.196263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eac9f5-f7c8-4ebe-a492-99bcf6edfa74 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:19.204606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 9/21] 10.222.0.44 () {56 vars in 1322 bytes} [Fri Oct 28 09:31:19 2022] GET /identity/v3/role_assignments?user.id=094fba2382e149f9b3e5ba2c3c144f8d&scope.domain.id=default&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 233 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:22.926614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f020e7-f88c-4da0-94c7-6bdc059a5853 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:22.927161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f020e7-f88c-4da0-94c7-6bdc059a5853 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:22.927680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f020e7-f88c-4da0-94c7-6bdc059a5853 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:22.930475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 13/22] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:22.938133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bfc7b-6728-4e2c-89a3-94ba44d8ad02 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:22.938864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bfc7b-6728-4e2c-89a3-94ba44d8ad02 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:22.939333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bfc7b-6728-4e2c-89a3-94ba44d8ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:22.975264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529af291-0ade-4e74-a552-e60dbcaa59d2 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:22.975757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529af291-0ade-4e74-a552-e60dbcaa59d2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:22.976266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529af291-0ade-4e74-a552-e60dbcaa59d2 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:22.978889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 14/23] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:22.986599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9054339-43e7-4aee-a953-8d9e13c4ff2b None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:22.987107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9054339-43e7-4aee-a953-8d9e13c4ff2b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:22.987609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9054339-43e7-4aee-a953-8d9e13c4ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:23.010305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-c61bfc7b-6728-4e2c-89a3-94ba44d8ad02 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:23.012783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-c61bfc7b-6728-4e2c-89a3-94ba44d8ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:23.073493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b9054339-43e7-4aee-a953-8d9e13c4ff2b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:23.074855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b9054339-43e7-4aee-a953-8d9e13c4ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:23.235438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 10/24] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:23.235607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 15/25] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:23.238023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222e63-f9ec-42ef-aa72-d74e3c9b5c16 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:23.238539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222e63-f9ec-42ef-aa72-d74e3c9b5c16 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:23.239042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222e63-f9ec-42ef-aa72-d74e3c9b5c16 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:23.242386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 16/26] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:23.248513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:23.248791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:23.249116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:23.290149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:23.292567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:23.369314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:23.481391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 11/27] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:23.691676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222e63-f9ec-42ef-aa72-d74e3c9b5c16 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:23.836673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:23.852414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222e63-f9ec-42ef-aa72-d74e3c9b5c16 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:23.900166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929e9da-b8fa-477a-b311-8e3fb72d5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:23.900842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929e9da-b8fa-477a-b311-8e3fb72d5865 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:23.901115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929e9da-b8fa-477a-b311-8e3fb72d5865 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:23.901387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929e9da-b8fa-477a-b311-8e3fb72d5865 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:23.902100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929e9da-b8fa-477a-b311-8e3fb72d5865 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:23.903761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929e9da-b8fa-477a-b311-8e3fb72d5865 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:23.916110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:24.094868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d2a8-7ed0-4820-879d-0252c4c43108 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:24.136571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:24.137237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.137517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.137793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.150301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:24.151834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:24.153273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 17/28] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Oct 28 09:31:23 2022] POST /identity/v3/roles => generated 225 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:31:24.156878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038840a-6f58-4e54-9291-99b94c9ffec6 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.157201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038840a-6f58-4e54-9291-99b94c9ffec6 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.164324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038840a-6f58-4e54-9291-99b94c9ffec6 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.166404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 18/29] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:24.167993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038840a-6f58-4e54-9291-99b94c9ffec6 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-97adcec1-b787-43a8-9caa-5413a726db89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:31:24.170804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:24.174730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 12/30] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ff88-6cce-4e6e-87ea-69701c29ef5c None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ff88-6cce-4e6e-87ea-69701c29ef5c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359ff88-6cce-4e6e-87ea-69701c29ef5c None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 13/31] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:24.185472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7e3c6-b717-43f5-9d75-7771af59293d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.188368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7e3c6-b717-43f5-9d75-7771af59293d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.188368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7e3c6-b717-43f5-9d75-7771af59293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.212284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6bd7e3c6-b717-43f5-9d75-7771af59293d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:24.213975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6bd7e3c6-b717-43f5-9d75-7771af59293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:24.218845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:24.324752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 14/32] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:24.327711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.328558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.329412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.343738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038840a-6f58-4e54-9291-99b94c9ffec6 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:24.356489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:24.359051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:24.401891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:24.402529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.403220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.403652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.405103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:24.408360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:24.458864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 19/33] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Oct 28 09:31:24 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:31:24.460471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:24.494990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 15/34] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:24.506487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:24.661506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e52885-220d-45eb-a759-c44f6a3624d5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:24.711898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:24.713007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:24.713501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:24.713982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:24.715198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:24.715732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:24.718844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:24.761082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 20/35] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:24.769568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:24.912690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:24.975485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7c21a-1fe5-4856-b5e5-8b796d2307e9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:24.993684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:25.056094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:25.056779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.057065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.057343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.058025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:25.060293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:25.095991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:25.130614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a85a16-2174-4f46-9f95-a73fb811b17f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:25.168007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa46c3-5d83-4c70-95ba-3112a794e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:25.168726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa46c3-5d83-4c70-95ba-3112a794e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.168859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa46c3-5d83-4c70-95ba-3112a794e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.169130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa46c3-5d83-4c70-95ba-3112a794e4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.181417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa46c3-5d83-4c70-95ba-3112a794e4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-2dfa46c3-5d83-4c70-95ba-3112a794e4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:25.187543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:25.188934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:25.190049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 21/36] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:25.190769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c2bd-7f5a-4429-8f68-dfc6b79a5794 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.190769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c2bd-7f5a-4429-8f68-dfc6b79a5794 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.190941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c2bd-7f5a-4429-8f68-dfc6b79a5794 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.192297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 22/37] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:25.193056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c2bd-7f5a-4429-8f68-dfc6b79a5794 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:25.209246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 16/38] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:31:24 2022] POST /identity/v3/projects => generated 301 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:31:25.210914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:25.355982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c2bd-7f5a-4429-8f68-dfc6b79a5794 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:25.374468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09fd42-2f84-4ca2-83c8-33b0148d28bf None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:25.397299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:25.405104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f176d0-8a27-4bef-9a1b-79e9457efe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:25.406008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f176d0-8a27-4bef-9a1b-79e9457efe7b None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.406627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f176d0-8a27-4bef-9a1b-79e9457efe7b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.406918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f176d0-8a27-4bef-9a1b-79e9457efe7b None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.408110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f176d0-8a27-4bef-9a1b-79e9457efe7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:25.409927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f176d0-8a27-4bef-9a1b-79e9457efe7b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:25.429868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:25.430413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 23/39] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Oct 28 09:31:25 2022] POST /identity/v3/roles => generated 223 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:31:25.436490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.436490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.436490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.459228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:25.460645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:25.460993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:25.461780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.462237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.462518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.463226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:25.463537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:25.466989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:25.486591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 17/40] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:25.492885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:25.590797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 24/41] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:25.682099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3faec-285e-490b-bcc9-371f27376fe6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:25.754277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:25.755390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.755876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.756392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.758633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:25.761299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:25.764470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 18/42] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:25 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:25.774435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:25.873390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:25.930332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151127f0-c60a-4a4e-ab04-d88fa14aa8e3 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:25.961536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:25.966341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:25.978537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:25.979310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:25.979628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:25.979964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:25.981218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:25.982724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:25.985576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 25/43] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:25.991359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:26.053605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faddee7-2e81-402d-b2e6-b92c85acf075 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:26.107401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd269a1e-43f6-4d0b-80b1-3940b5e5b361 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:26.116267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:26.117280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:26.117682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:26.118079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:26.120114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:26.122964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:26.127382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 19/44] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:26.133969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:26.155448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667848c-9528-4226-b8e6-8f43ed10f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:26.156915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667848c-9528-4226-b8e6-8f43ed10f3f8 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:26.157389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667848c-9528-4226-b8e6-8f43ed10f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:26.157851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667848c-9528-4226-b8e6-8f43ed10f3f8 None admin] PATH_INFO: `/v3/domains/default/users/094fba2382e149f9b3e5ba2c3c144f8d/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:26.161406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667848c-9528-4226-b8e6-8f43ed10f3f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=094fba2382e149f9b3e5ba2c3c144f8d, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:26.164184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667848c-9528-4226-b8e6-8f43ed10f3f8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:26.190075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 26/45] 10.222.0.44 () {58 vars in 1361 bytes} [Fri Oct 28 09:31:25 2022] PUT /identity/v3/domains/default/users/094fba2382e149f9b3e5ba2c3c144f8d/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:31:26.292072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f95f9f-04c6-42dd-930b-3b3e6647697e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:26.488384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:26.516009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afea285-7076-4824-9096-2a5b1e24070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:26.517004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea285-7076-4824-9096-2a5b1e24070e None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:26.517459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea285-7076-4824-9096-2a5b1e24070e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:26.517898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea285-7076-4824-9096-2a5b1e24070e None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:26.519112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afea285-7076-4824-9096-2a5b1e24070e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:26.521842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afea285-7076-4824-9096-2a5b1e24070e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:26.570903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 20/46] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:31:26 2022] POST /identity/v3/projects => generated 312 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:31:28.875208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d885c-fbd6-45f8-b438-fc383561056c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:28.875781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d885c-fbd6-45f8-b438-fc383561056c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:28.876206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d885c-fbd6-45f8-b438-fc383561056c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:28.878818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 27/47] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:28.886424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace136-1c5d-4895-bcf4-4bc8287221a6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:28.887010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace136-1c5d-4895-bcf4-4bc8287221a6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:28.887353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace136-1c5d-4895-bcf4-4bc8287221a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:28.916103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-99ace136-1c5d-4895-bcf4-4bc8287221a6 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:28.917768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-99ace136-1c5d-4895-bcf4-4bc8287221a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:29.011594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 21/48] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:29.085639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce34d-6df3-438b-955b-7f8618a8b262 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:29.086011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce34d-6df3-438b-955b-7f8618a8b262 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:29.086359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce34d-6df3-438b-955b-7f8618a8b262 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:29.087819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 28/49] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:29.094024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:29.094311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:29.094829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:29.127758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:29.129825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:29.259650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 22/50] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:29.306978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce34d-6df3-438b-955b-7f8618a8b262 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:29.375354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:29.470300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce34d-6df3-438b-955b-7f8618a8b262 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:29.533747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:29.534787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:29.535222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:29.535620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:29.537521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:29.540075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:29.543421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 29/51] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:29.549799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:29.590293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:29.615788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:29.688567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9c2b3-7ccd-479e-b821-06bdb7ae7095 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:29.727019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:29.727555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:29.727840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:29.728121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:29.728842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:29.730348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:29.766325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 23/52] 10.222.0.44 () {60 vars in 1140 bytes} [Fri Oct 28 09:31:29 2022] POST /identity/v3/projects => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:31:29.771077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad545-f4b6-458f-aa3e-4089bae6d54c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:29.793077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:29.815561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:29.816218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:29.816538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:29.816813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:29.830528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:29.836279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:29.837579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:29.838474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 30/53] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:29.844629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:29.947591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:29.968235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724479ea-61cd-42ce-bd19-c81f6a745c8d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:30.009606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:30.010162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:30.010448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:30.010725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:30.011415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:30.011724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:30.013232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:30.023979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 24/54] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:30.030185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:30.324718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a596d-c09f-4796-9920-c4f935991b18 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:30.383174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:30.383961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:30.384376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:30.384737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:30.386161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:30.387801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:30.389755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 31/55] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:30 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:30.396406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:30.551506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8e89c-500f-463e-93a8-9e23981f3371 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:30.593414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b9afd-eb78-45e5-8a07-6a67c0d89f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:30.594010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9afd-eb78-45e5-8a07-6a67c0d89f77 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:30.594290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9afd-eb78-45e5-8a07-6a67c0d89f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:30.594577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9afd-eb78-45e5-8a07-6a67c0d89f77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:30.595800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b9afd-eb78-45e5-8a07-6a67c0d89f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:30.597366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b9afd-eb78-45e5-8a07-6a67c0d89f77 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:30.599035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 25/56] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:30.605356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:30.661281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:30.743616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1669c-b891-49bf-b7de-01af9473edee None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:30.783021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:30.783733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:30.784079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:30.784576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:30.785871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.domain.id=default, user.id=094fba2382e149f9b3e5ba2c3c144f8d) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:30.786432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:30.789240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7b8dd-9d2e-4691-acc8-f0f0404e1646 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:30.816285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 32/57] 10.222.0.44 () {56 vars in 1322 bytes} [Fri Oct 28 09:31:30 2022] GET /identity/v3/role_assignments?user.id=094fba2382e149f9b3e5ba2c3c144f8d&scope.domain.id=default&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 530 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:32.193181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc028f-494f-4464-a34d-2754102182c7 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:32.193728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc028f-494f-4464-a34d-2754102182c7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:32.193857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc028f-494f-4464-a34d-2754102182c7 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:32.195649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 26/58] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:32.201845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:32.202412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:32.202601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:32.222796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:32.224029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:32.301342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 33/59] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:32.591231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc028f-494f-4464-a34d-2754102182c7 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:32.609053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:32.721847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc028f-494f-4464-a34d-2754102182c7 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:32.762261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722cfb-5ac6-4764-a620-8cb283ca1b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:32.762964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722cfb-5ac6-4764-a620-8cb283ca1b5e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:32.763289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722cfb-5ac6-4764-a620-8cb283ca1b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:32.763611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722cfb-5ac6-4764-a620-8cb283ca1b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:32.765603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07722cfb-5ac6-4764-a620-8cb283ca1b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:32.767170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07722cfb-5ac6-4764-a620-8cb283ca1b5e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:32.768860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 27/60] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:32.774848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:32.824938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:32.890928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e604359-9552-4558-81ce-606bdf9f26c4 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:32.932052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5379e60-2cc4-4476-b6b2-bb4a14768bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:32.932720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5379e60-2cc4-4476-b6b2-bb4a14768bc7 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:32.933004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5379e60-2cc4-4476-b6b2-bb4a14768bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:32.933283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5379e60-2cc4-4476-b6b2-bb4a14768bc7 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:32.933977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5379e60-2cc4-4476-b6b2-bb4a14768bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:32.935493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5379e60-2cc4-4476-b6b2-bb4a14768bc7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:32.966921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 34/61] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:31:32 2022] POST /identity/v3/users => generated 275 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:31:36.895934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a438ff-2b6d-4df2-afd6-5d799e65ee6f None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:36.897411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a438ff-2b6d-4df2-afd6-5d799e65ee6f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:36.898115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a438ff-2b6d-4df2-afd6-5d799e65ee6f None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:36.901489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 28/62] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:36.911481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:36.912812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:36.913545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:36.958075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:36.960530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:37.120671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1def2-1088-4f79-acbb-9e9600973322 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:37.121700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1def2-1088-4f79-acbb-9e9600973322 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:37.122661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1def2-1088-4f79-acbb-9e9600973322 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:37.126344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 29/63] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:37.144921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:37.146115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:37.147004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:37.153604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 35/64] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:37.190477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:37.192444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:37.330935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 30/65] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:37.729035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:37.788427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:37.909987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:37.957361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:38.005351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795e59-6fce-46e7-845a-1a894d097b37 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:38.088050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4218854-dde1-4d52-913e-ac62b95e2fd9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:38.097463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a4e2-9c6c-46c1-8485-9ac01fbcda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:38.098375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a4e2-9c6c-46c1-8485-9ac01fbcda6b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.098799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a4e2-9c6c-46c1-8485-9ac01fbcda6b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.099239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a4e2-9c6c-46c1-8485-9ac01fbcda6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.118069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a4e2-9c6c-46c1-8485-9ac01fbcda6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d3c2a4e2-9c6c-46c1-8485-9ac01fbcda6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:38.128089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:38.129032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:38.129773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:38.130348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 36/66] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:38.133502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766b6aa-c37a-40da-8124-e00ae42e8e5b None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.134004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766b6aa-c37a-40da-8124-e00ae42e8e5b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.134505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766b6aa-c37a-40da-8124-e00ae42e8e5b None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.137364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 37/67] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:38.140186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2632bc-5997-47cc-87e7-eb505035175d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.141121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2632bc-5997-47cc-87e7-eb505035175d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.141635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2632bc-5997-47cc-87e7-eb505035175d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.144336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 38/68] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:38.146082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2632bc-5997-47cc-87e7-eb505035175d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:38.154127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a11b74-73ce-473b-839f-92dd6249782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:38.154787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a11b74-73ce-473b-839f-92dd6249782d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.155270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a11b74-73ce-473b-839f-92dd6249782d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.155697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a11b74-73ce-473b-839f-92dd6249782d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.169182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a11b74-73ce-473b-839f-92dd6249782d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-56a11b74-73ce-473b-839f-92dd6249782d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:38.176376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:38.177465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:38.178407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 31/69] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:38.179179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc4ae5-bb28-4f68-832b-10fb397bcfd7 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.179179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc4ae5-bb28-4f68-832b-10fb397bcfd7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.179775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc4ae5-bb28-4f68-832b-10fb397bcfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.201350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-cdcc4ae5-bb28-4f68-832b-10fb397bcfd7 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:38.203438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-cdcc4ae5-bb28-4f68-832b-10fb397bcfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:38.292949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:38.300598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 32/70] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:38.301933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d430-443b-4699-8475-dfa47d79c451 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.302261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d430-443b-4699-8475-dfa47d79c451 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.302515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d430-443b-4699-8475-dfa47d79c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.309497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:38.324001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-dc51d430-443b-4699-8475-dfa47d79c451 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:38.325299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-dc51d430-443b-4699-8475-dfa47d79c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:38.334563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2632bc-5997-47cc-87e7-eb505035175d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:38.410048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:38.411069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.411555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.412036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.413348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:38.414103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:38.417005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:38.435238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 39/71] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:38.436070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 33/72] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:38.438610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:38.439118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f309-cce5-4cb2-b832-e3be60875df7 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.439708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f309-cce5-4cb2-b832-e3be60875df7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.448301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f309-cce5-4cb2-b832-e3be60875df7 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.448301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 34/73] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:38.448301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96f309-cce5-4cb2-b832-e3be60875df7 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:38.613301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1d541-587c-4eed-a725-5b5fdb4de589 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:38.661195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:38.662074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.662529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.662950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.663899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:38.664394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:38.666370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237cf3-42bf-4856-9bd7-8fa21f03ff0b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:38.676544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 40/74] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:38.678351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.678853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.679435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.679536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96f309-cce5-4cb2-b832-e3be60875df7 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:38.700973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:38.702696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:38.709697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:38.750022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:38.759824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:38.761454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:38.762462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:38.762978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:38.790379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:38.793045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:38.801645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 35/75] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:38 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:38.801645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:38.825769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 41/76] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:38.827607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:38.963752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465e0f9-a73d-45e1-865d-a60e53dba887 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.010217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c548e-af7f-4371-80a4-acb6e88577f6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.022704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.023734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.024206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.024711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.036528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:39.041931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:39.049742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:39.051502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:39.053100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 42/77] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:31:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:39.054389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:39.064382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.065065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.065352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.065689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.066926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:39.069220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:39.080230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 36/78] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:38 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:39.080230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:39.155484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:39.213514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca55d5-713a-45f4-b1bb-c416d0ebb838 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.214059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83db35a-5950-44d3-b8bb-788f818ef9c0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.264521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.265636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.265921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.266201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.267459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:39.268990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:39.269102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.270127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.270624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.270798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 37/79] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:39.275733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.275850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:39.357758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:39.361839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:39.363196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:39.433543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c562847-98c5-45e1-88f1-3e46dc8be5d6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.469002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:39.481983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.483048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.483495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.483942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.485151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:39.485660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:39.488082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:39.501732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 38/80] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:31:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:39.503197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:39.516791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 43/81] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:39.518177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:39.656481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29323-1489-4e90-bd28-8670a4f6fb80 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.659095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:39.663275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9536d-46cc-41e9-b4fa-1b3fafc74cdf None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.705800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.706164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:39.706449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.706726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.707086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.707233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:39.707728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:39.708267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:39.709509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:39.712371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:39.748824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 44/82] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:31:39 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:31:39.750308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:39.789885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:39.809321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:39.811219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:39.939589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5bf1-7c35-415e-ada5-82904f4bc4ae None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:39.984273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 39/83] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:39.984273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.007749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.008669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.009124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.009602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.026780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:40.036439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:40.038020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:40.039371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 45/84] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:40.041426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.075194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:40.171014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:40.194037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13501da8-5010-4221-a9f5-44b2d2860d94 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:40.212194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a17e1-6f2f-4b50-bec8-88b9fa3cc815 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:40.249210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.250273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.250273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.250528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.251701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:40.253339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:40.255667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 40/85] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:39 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:40.256549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.289894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.291715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.292910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.292910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.297013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:40.299944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:40.303701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 46/86] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:40.305440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.415407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cd9b9-4a08-4d46-994d-a678597cf976 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:40.465331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.465995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.466291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.466604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.468881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:40.470514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:40.472374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 41/87] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:40.473209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.493421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:40.512064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:40.529374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35acd2-b58c-4326-8502-48692cc8f5c8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:40.591778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.594036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.594853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.595655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.597207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:40.598052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:40.601179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:40.617888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 47/88] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:40.619842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.634949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e3c1-2b29-480c-be5c-14febc6d7525 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:40.686696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.687450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.687761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.688055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.803865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:40.805628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:40.823099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c0824-dc7b-43cb-b04d-28a0700033c9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:40.848142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:40.877389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:40.878026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:40.878310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:40.878583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:40.879352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=36a7fb13d1554e398c0fa58a63147893) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:40.879663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:40.881231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:40.890104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 48/89] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/role_assignments?user.id=36a7fb13d1554e398c0fa58a63147893&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=1d69c101c31d486496fd3165551273f4 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:40.891099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:40.909518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:40.970829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 42/90] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:40.977102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:41.053451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8f4ca-8708-4278-af24-c389a86bbc67 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:41.111329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:41.111888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:41.112170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:41.112474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:41.113446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=094fba2382e149f9b3e5ba2c3c144f8d) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:41.113807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:41.121217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:41.125792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee47a3-879b-40fb-ace1-c47bc07103f1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:41.142510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 49/91] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/role_assignments?user.id=094fba2382e149f9b3e5ba2c3c144f8d&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:41.143524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:41.179321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:41.199522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:41.200220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:41.202843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:41.203196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:41.204729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:41.206300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:41.208084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 43/92] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:40 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:41.225884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:41.299789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:41.351303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4531b-4ef8-4954-9764-6f6f28ee27ec None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:41.422436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae056a-66d0-4a6a-ae02-eefa96eefff8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:41.442516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:41.443189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:41.443469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:41.443743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:41.447228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:41.448793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:41.450841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 50/93] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:41 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:41.457669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:41.517355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:41.518006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:41.518308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:41.518565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:41.718534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22332a-5fc0-42d8-b7e1-5855e0ac04e8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:41.742334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:41.779688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:41.782624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:41.803479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:41.804545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:41.805041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:41.805749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:41.806786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] RBAC: Adding query filter params (role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=36a7fb13d1554e398c0fa58a63147893) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:41.807298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:41.809077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:41.824284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 51/94] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:41 2022] GET /identity/v3/role_assignments?user.id=36a7fb13d1554e398c0fa58a63147893&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:41.938439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 44/95] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:31:41.944228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:41.959533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:42.120167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac55c3-6318-4f92-b343-8999bb0303b4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:42.166935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b2d41-afad-4fed-876d-c4bf57cca0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:42.167962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2d41-afad-4fed-876d-c4bf57cca0d5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:42.168493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2d41-afad-4fed-876d-c4bf57cca0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:42.168963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2d41-afad-4fed-876d-c4bf57cca0d5 None admin] PATH_INFO: `/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:42.170494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b2d41-afad-4fed-876d-c4bf57cca0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=4aa7ba9e07ff444ba3df6ac6b02ca8e5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:42.172867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b2d41-afad-4fed-876d-c4bf57cca0d5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:42.174923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 52/96] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:41 2022] GET /identity/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:42.181234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:42.298990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:42.315663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12567a7-99d4-4286-aa85-ae157211f9b9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:42.371652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:42.372674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:42.373183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:42.373703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:42.375040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=4aa7ba9e07ff444ba3df6ac6b02ca8e5, user.id=36a7fb13d1554e398c0fa58a63147893) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:42.375599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:42.377360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08101490-59c2-4028-944d-59e04abf1367 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:42.384377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 45/97] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:42 2022] GET /identity/v3/role_assignments?user.id=36a7fb13d1554e398c0fa58a63147893&scope.project.id=4aa7ba9e07ff444ba3df6ac6b02ca8e5&role.id=1d69c101c31d486496fd3165551273f4 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:43.511660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838582-6114-41ab-90df-208795fad1e9 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:43.512693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838582-6114-41ab-90df-208795fad1e9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:43.513172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838582-6114-41ab-90df-208795fad1e9 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:43.515667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 53/98] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:43.521718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2494-3779-4566-826e-2f27330fbbce None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:43.522233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2494-3779-4566-826e-2f27330fbbce None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:43.522303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2494-3779-4566-826e-2f27330fbbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:43.543359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f896-1c8e-4905-be9a-1f1727b9b275 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:43.544003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f896-1c8e-4905-be9a-1f1727b9b275 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:43.544513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f896-1c8e-4905-be9a-1f1727b9b275 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:43.546653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-7a3c2494-3779-4566-826e-2f27330fbbce None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:43.547448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 54/99] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:43.550198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7a3c2494-3779-4566-826e-2f27330fbbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:43.557269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387bd99-3bd8-4a02-8718-b6628cbe1253 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:43.557907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387bd99-3bd8-4a02-8718-b6628cbe1253 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:43.558387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387bd99-3bd8-4a02-8718-b6628cbe1253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:43.600041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-4387bd99-3bd8-4a02-8718-b6628cbe1253 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:43.602029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-4387bd99-3bd8-4a02-8718-b6628cbe1253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:43.716527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 46/100] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:43.753804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 55/101] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:31:44.156221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6f37-25fd-457a-818e-3981d65ad943 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:44.157055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6f37-25fd-457a-818e-3981d65ad943 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:44.157549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6f37-25fd-457a-818e-3981d65ad943 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:44.159197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 47/102] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:44.165496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:44.166115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:44.166581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:44.177101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:44.192086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:44.193695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:44.292325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 56/103] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:44.433013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6f37-25fd-457a-818e-3981d65ad943 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:44.556231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:44.564610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:44.594450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6f37-25fd-457a-818e-3981d65ad943 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:44.670914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:44.672201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:44.672707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:44.673200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:44.674685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:44.676470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:44.678704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 48/104] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:44.688233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:44.893848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b783-ea19-46e9-b4cf-861505345e9f None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:44.994266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:44.995266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:44.995764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:44.996274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.000159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:45.035505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:45.040394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d20abb-dcaa-4bfa-800c-37fecade1b64 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:45.053851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:45.055408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:45.056905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 57/105] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 492 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:31:45.066105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:45.190124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be40279-92ee-499b-a196-35730994d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:45.191223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be40279-92ee-499b-a196-35730994d79c None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.191751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be40279-92ee-499b-a196-35730994d79c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.192267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be40279-92ee-499b-a196-35730994d79c None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.193540 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be40279-92ee-499b-a196-35730994d79c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:45.200292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be40279-92ee-499b-a196-35730994d79c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:45.283894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 49/106] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:31:44 2022] POST /identity/v3/projects => generated 302 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:31:45.286185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be40279-92ee-499b-a196-35730994d79c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:45.325718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:45.357069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc2226-1bbb-4044-a56e-fe67d91751d8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:45.445582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:45.446646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.447139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.447627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.452307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:45.452864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:45.455846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:45.487856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 58/107] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:45.508539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:45.597233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be40279-92ee-499b-a196-35730994d79c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:45.675568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:45.677120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.678153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.678845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.696055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:45.703545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:45.704609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:45.705347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:45.707409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 50/108] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:45.721313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:45.724428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:45.820816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:45.853940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01975624-856b-45e2-885c-a3a3f839d47e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:45.898341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:45.899171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.899586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.899866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.900600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:45.900911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:45.902556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ee41d-2c4e-481b-9be5-ea7fe516837e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:45.908346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecaa73-b44a-4a7a-aef6-0c2d359e7f35 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:45.914452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 51/109] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:45.916131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79916-ae60-4d0d-92e3-8452cee864c4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.916441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79916-ae60-4d0d-92e3-8452cee864c4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.916688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79916-ae60-4d0d-92e3-8452cee864c4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.918274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 52/110] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:45.929820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.930099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.930371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:45.954914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:45.956903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:45.985219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:45.986600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:45.987275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:45.987894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] PATH_INFO: `/v3/users/d01430c3559443bb9afe07782ab2e1ba` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:46.023697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] RBAC: Authorizing `identity:get_user(user_id=d01430c3559443bb9afe07782ab2e1ba)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:46.026870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:46.036770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 59/111] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:45 2022] GET /identity/v3/users/d01430c3559443bb9afe07782ab2e1ba => generated 289 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:46.038207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:46.053259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 53/112] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:46.054223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:46.147421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:46.197362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9a191-70c4-4357-911c-b67737c2ae54 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:46.242237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bee486-cced-434f-ad1c-d2129f346ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:46.242900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee486-cced-434f-ad1c-d2129f346ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:46.243183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee486-cced-434f-ad1c-d2129f346ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:46.243796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee486-cced-434f-ad1c-d2129f346ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:46.332645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bee486-cced-434f-ad1c-d2129f346ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:46.334228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bee486-cced-434f-ad1c-d2129f346ee1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:46.418738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:46.448025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7101f-912c-4df8-927c-aa2139708e87 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:46.466742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:46.532350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 54/113] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:46.538795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62556de-909a-49c1-83de-a9659ffe60f6 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:46.540992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62556de-909a-49c1-83de-a9659ffe60f6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:46.542301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62556de-909a-49c1-83de-a9659ffe60f6 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:46.546636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 55/114] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:46.557557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62556de-909a-49c1-83de-a9659ffe60f6 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:46.559148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4145940-0215-49d6-a914-3df113cce2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:46.560643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145940-0215-49d6-a914-3df113cce2e4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:46.562089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145940-0215-49d6-a914-3df113cce2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:46.562886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4145940-0215-49d6-a914-3df113cce2e4 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:46.566160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145940-0215-49d6-a914-3df113cce2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:46.578277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4145940-0215-49d6-a914-3df113cce2e4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:46.588288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 60/115] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:46 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:46.588288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:46.588288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:46.588288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:46.652778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:46.658570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:46.854269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 61/116] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:46.863218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:46.892280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62556de-909a-49c1-83de-a9659ffe60f6 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:46.945661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:46.946319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:46.946600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:46.946879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:46.948387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:46.949953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:46.952899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 56/117] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:46 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:46.953754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:47.027397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:47.062803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e9c71-e773-4bfe-b53e-45f21afcd7a3 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:47.082425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:47.109062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53747140-cccf-4188-8a67-0631c8eb182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:47.109630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747140-cccf-4188-8a67-0631c8eb182a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.110068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747140-cccf-4188-8a67-0631c8eb182a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.110226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747140-cccf-4188-8a67-0631c8eb182a None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.111526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747140-cccf-4188-8a67-0631c8eb182a None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:47.113061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747140-cccf-4188-8a67-0631c8eb182a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:47.115028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 62/118] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:46 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:47.116184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cdca4-3aab-4103-bee5-a37713d604cb None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.121685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cdca4-3aab-4103-bee5-a37713d604cb None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.121981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cdca4-3aab-4103-bee5-a37713d604cb None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.123826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 63/119] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:47.124738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cdca4-3aab-4103-bee5-a37713d604cb None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:47.224808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9599cf-28f7-49d0-a50b-feee62f571f9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:47.263110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cdca4-3aab-4103-bee5-a37713d604cb None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:47.305049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c644b8-7522-44a3-a8d7-fc9ed672d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:47.306135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c644b8-7522-44a3-a8d7-fc9ed672d579 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.306618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c644b8-7522-44a3-a8d7-fc9ed672d579 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.307102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c644b8-7522-44a3-a8d7-fc9ed672d579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.308892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:47.309523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.309805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.310077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.310959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] RBAC: Adding query filter params (role.id=86898a54faa04b9983a188007dd22db9, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=d01430c3559443bb9afe07782ab2e1ba) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:47.311406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:47.312954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:47.328535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 64/120] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:47 2022] GET /identity/v3/role_assignments?user.id=d01430c3559443bb9afe07782ab2e1ba&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=86898a54faa04b9983a188007dd22db9 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:47.328535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:47.328814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c644b8-7522-44a3-a8d7-fc9ed672d579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-b3c644b8-7522-44a3-a8d7-fc9ed672d579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:47.338025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:47.338952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:47.339694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:47.340287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 57/121] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:47.342747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.343241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.343829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.376078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:47.377480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:47.417283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:47.469115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 58/122] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:47.469889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:47.503323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:47.558685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976f9f-c986-41a2-813f-31558432d6ca None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:47.639986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:47.641726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.642478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.643233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/36a7fb13d1554e398c0fa58a63147893/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.647136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc04c5e3ac948a5937330bd116beba5, user_id=36a7fb13d1554e398c0fa58a63147893, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:47.650792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:47.678480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 65/123] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:31:47 2022] PUT /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/36a7fb13d1554e398c0fa58a63147893/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:31:47.680658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:47.695206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd47fe5-a3d4-42b1-a09c-e8c5cbf74f4a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:47.768429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:47.769795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:47.770800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:47.771587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:47.796375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:47.807703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:47.809663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:47.811170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:47.815978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 59/124] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:31:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:47.829971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:48.026201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151c5d5-884a-468b-8778-14c3a4b357c0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:48.039730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:48.110138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:48.111227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:48.111727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:48.112235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:48.113561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:48.114095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:48.114964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:48.117379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:48.135237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 66/125] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:48.138359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:48.179430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451c02f-6f90-4682-a376-ad88e25a0ca8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:48.307602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:48.308546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:48.309031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:48.309504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:48.311515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:48.313444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:48.316388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:48.349635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 60/126] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:31:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:48.351208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:48.478273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf6a2-07bf-4aad-a2ab-2ca9ced48bb0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:48.556385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:48.557507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:48.558063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:48.558504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:48.588580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:48.599609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:48.600591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:48.601379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 67/127] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:48.602502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:48.619522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c9063-fd7d-4733-b1bd-4b1f9594d028 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:48.642524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:48.726116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:48.726796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:48.727153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:48.727440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:48.728678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:48.730179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:48.732064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 61/128] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:48 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:48.736158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9ebb6-a2b7-4cee-a4ff-1207f59d1851 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:48.738582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:48.753697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:48.778122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:48.778824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:48.779105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:48.779396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:48.782127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:48.783637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:48.786034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 68/129] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:48 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:48.786322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:49.020648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:49.030447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a20e0-3b58-4fb4-9d4e-5a401f8c0014 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.046495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b52c9-3959-4650-9b8d-d582cc173658 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.080909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.081974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.082476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.082955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.084620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.086407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.088542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 69/130] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:48 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:49.089629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:49.133171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.133923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.134127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.134412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.135265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:49.135582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.137479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.157261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 62/131] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:49.157957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:49.215160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c36a2-646e-43d8-844f-5cb5fa39af53 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.254810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.255829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.256351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.256856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.267765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.267765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.268007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 70/132] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:49 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:49.268671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:49.321010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:49.345971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:49.415548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ef7c8-9b8f-4614-aabe-b93231f9c256 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.488671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baed45c-a732-4530-b856-9419ddac461c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.519554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681943a3-1a4d-4146-b91c-01075f24a482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.520280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681943a3-1a4d-4146-b91c-01075f24a482 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.520580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681943a3-1a4d-4146-b91c-01075f24a482 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.520865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681943a3-1a4d-4146-b91c-01075f24a482 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/094fba2382e149f9b3e5ba2c3c144f8d/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.526713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681943a3-1a4d-4146-b91c-01075f24a482 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc04c5e3ac948a5937330bd116beba5, user_id=094fba2382e149f9b3e5ba2c3c144f8d, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.529902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681943a3-1a4d-4146-b91c-01075f24a482 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.548035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.549016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.549179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.549364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.550644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.552517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.555039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 71/133] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:49 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:49.555970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:49.561730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 63/134] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:31:49 2022] PUT /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/094fba2382e149f9b3e5ba2c3c144f8d/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:31:49.564538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ec34e-aafd-4a96-a3b8-d615c24896e2 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.565360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ec34e-aafd-4a96-a3b8-d615c24896e2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.566102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ec34e-aafd-4a96-a3b8-d615c24896e2 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.568969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 64/135] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:49.578567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ec34e-aafd-4a96-a3b8-d615c24896e2 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:49.816840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:49.830417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de19c-b3d7-4beb-8da8-374fc23eb4a1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.839941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ec34e-aafd-4a96-a3b8-d615c24896e2 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:49.873876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:49.884458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aecb1-866e-40da-a7d3-619a04351f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.885205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aecb1-866e-40da-a7d3-619a04351f40 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.885486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aecb1-866e-40da-a7d3-619a04351f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.885761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aecb1-866e-40da-a7d3-619a04351f40 None admin] PATH_INFO: `/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.887229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aecb1-866e-40da-a7d3-619a04351f40 None admin] RBAC: Authorizing `identity:get_project(project_id=4aa7ba9e07ff444ba3df6ac6b02ca8e5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.888850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aecb1-866e-40da-a7d3-619a04351f40 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.891719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 65/136] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:49 2022] GET /identity/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5 => generated 312 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:49.893031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.893329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.893612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.905344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:49.906576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:49.907082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:49.907588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/36a7fb13d1554e398c0fa58a63147893/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:49.917914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc04c5e3ac948a5937330bd116beba5, user_id=36a7fb13d1554e398c0fa58a63147893, role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:49.919398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:49.921205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:49.922492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:49.947102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 72/137] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:31:49 2022] PUT /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/36a7fb13d1554e398c0fa58a63147893/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:31:49.948079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:50.020392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 66/138] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:50.167038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30cc87-80e0-4467-9e1a-8bbb5de10dcb None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:50.224104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:50.224836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:50.225137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:50.225413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] PATH_INFO: `/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5/users/36a7fb13d1554e398c0fa58a63147893/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:50.227508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] RBAC: Authorizing `identity:create_grant(project_id=4aa7ba9e07ff444ba3df6ac6b02ca8e5, user_id=36a7fb13d1554e398c0fa58a63147893, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:50.229041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:50.247457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 73/139] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:31:49 2022] PUT /identity/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5/users/36a7fb13d1554e398c0fa58a63147893/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:31:50.395923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:50.543890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8637c-8811-4884-93cd-61a3c5256b75 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:50.579587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:50.590067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abc9d5-16bc-4877-a1b4-8685b706d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:50.591320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abc9d5-16bc-4877-a1b4-8685b706d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:50.594423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abc9d5-16bc-4877-a1b4-8685b706d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:50.595443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abc9d5-16bc-4877-a1b4-8685b706d4e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:50.598214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abc9d5-16bc-4877-a1b4-8685b706d4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:50.601431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abc9d5-16bc-4877-a1b4-8685b706d4e9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:50.604662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 67/140] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:50.614712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:50.654538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:50.841271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b548f-20d9-49ad-aa1d-e01093faacdb None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:50.841770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b548f-20d9-49ad-aa1d-e01093faacdb None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:50.842413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b548f-20d9-49ad-aa1d-e01093faacdb None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:50.845232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 68/141] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:50.853378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:50.853878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:50.854470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:50.860455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdf97-2ee3-4e1f-9b0a-b424d0f3fc28 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:50.927409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:50.928685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:50.964018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d932916-bd6c-4038-9aa9-628388d933c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:50.964685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932916-bd6c-4038-9aa9-628388d933c7 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:50.964966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932916-bd6c-4038-9aa9-628388d933c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:50.965244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932916-bd6c-4038-9aa9-628388d933c7 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:50.965939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d932916-bd6c-4038-9aa9-628388d933c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:50.969152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d932916-bd6c-4038-9aa9-628388d933c7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:51.013152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 74/142] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:31:50 2022] POST /identity/v3/users => generated 283 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:31:51.016169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f06e-ae0c-4fe6-87ad-c1117f8f849e None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:51.016536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f06e-ae0c-4fe6-87ad-c1117f8f849e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:51.016786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f06e-ae0c-4fe6-87ad-c1117f8f849e None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:51.027779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 75/143] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:51.034534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:51.034939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:51.035104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:51.082113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:51.084679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:51.094080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 69/144] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:51.262161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 76/145] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:31:51.589370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:51.708921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb3c05-23c4-4dab-a0bb-2922b843d20b None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:51.752376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:51.777869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:51.778974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:51.779537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:51.780041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:51.810331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:51.820452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:51.821370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:31:51.822127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:51.822701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 70/146] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:51.833612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:51.843671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:51.883703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.043835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fa579-1ead-49e0-8c80-485962b84034 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.096628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.097660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.099089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.099780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.102762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:52.104402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:52.107998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:52.118480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 77/147] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:52.127918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.133615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dbf59-284c-4ea7-8dc9-7d379c2702f2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.196026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.196026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.196026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.196026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.213139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:52.222394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:52.223316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:52.225621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 71/148] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:31:52.256794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:52.261366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.300294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf616b-8391-4d11-9713-3c9a87b938e0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.337533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:52.357323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.358661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.358958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.359241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] PATH_INFO: `/v3/users/d01430c3559443bb9afe07782ab2e1ba` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.360525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=d01430c3559443bb9afe07782ab2e1ba)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:52.362037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:52.363858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 78/149] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:52 2022] GET /identity/v3/users/d01430c3559443bb9afe07782ab2e1ba => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:52.373894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.420603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05411788-2d29-4ff8-a420-eef194b0b4cb None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.474739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.475423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.475730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.476026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.476804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:52.477136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:52.483904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:52.494214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 72/150] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:52.505333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.634042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0804-fb45-403a-a9f1-ef94752ad8d4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.723871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.724635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.724923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.725248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.727677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:52.729223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:52.736407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 79/151] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:52 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:52.737981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.745934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:52.749630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43040-7e21-4d94-8815-69e0b5099646 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.763538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:52.908221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.909733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.910493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.911252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.913787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:52.917118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:52.922787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 73/152] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:52 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:52.930879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2d9e-ecd7-427b-9e39-3dfa6d4574f6 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:52.933027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:52.990976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d007cb9-728c-4b0e-bc06-f4fc6e168a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:52.991690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d007cb9-728c-4b0e-bc06-f4fc6e168a36 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:52.991977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d007cb9-728c-4b0e-bc06-f4fc6e168a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:52.992287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d007cb9-728c-4b0e-bc06-f4fc6e168a36 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/d01430c3559443bb9afe07782ab2e1ba/roles/86898a54faa04b9983a188007dd22db9` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:52.999642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d007cb9-728c-4b0e-bc06-f4fc6e168a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc04c5e3ac948a5937330bd116beba5, user_id=d01430c3559443bb9afe07782ab2e1ba, role_id=86898a54faa04b9983a188007dd22db9)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:53.001222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d007cb9-728c-4b0e-bc06-f4fc6e168a36 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:53.034146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 80/153] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:31:52 2022] PUT /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5/users/d01430c3559443bb9afe07782ab2e1ba/roles/86898a54faa04b9983a188007dd22db9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:31:53.212952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5220b93-9ab8-4e1c-835f-2914c93a4163 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:53.288724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:53.289747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:53.290483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:53.290961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:53.397244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:53.466145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:53.469520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:53.492399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c51f-4325-4a92-aa7e-e157bad5fedb None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:53.493023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c51f-4325-4a92-aa7e-e157bad5fedb None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:53.493378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c51f-4325-4a92-aa7e-e157bad5fedb None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:53.496213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 81/154] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:31:53.506005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:53.506487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:53.506967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:53.569953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:53.571885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:53.701736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 74/155] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:53.710633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:53.766213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:53.801277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 82/156] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:53.833890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:53.870072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787831fc-104e-45e6-a01c-40d85a56d27a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:53.913325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5e28-f96a-4a1a-8a0e-ffb82e638407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:53.914209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5e28-f96a-4a1a-8a0e-ffb82e638407 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:53.914553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5e28-f96a-4a1a-8a0e-ffb82e638407 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:53.915146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5e28-f96a-4a1a-8a0e-ffb82e638407 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:53.916865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5e28-f96a-4a1a-8a0e-ffb82e638407 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:53.918757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5e28-f96a-4a1a-8a0e-ffb82e638407 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:53.921231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 75/157] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:53 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:53.931744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:53.991811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267c424-0e82-4395-a759-7800e0f5a262 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:53.992273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267c424-0e82-4395-a759-7800e0f5a262 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:53.992539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267c424-0e82-4395-a759-7800e0f5a262 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:53.994650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 76/158] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:54.007678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:54.008069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:54.008428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:54.054029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:54.055418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:54.176938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 77/159] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:31:54.195157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02441eea-11a2-4bf8-8de1-d86def5664bc None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:54.285796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:54.287378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:54.288121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:54.289003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:54.290841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=36a7fb13d1554e398c0fa58a63147893) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:54.291662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:54.294738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:54.307878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 83/160] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:53 2022] GET /identity/v3/role_assignments?user.id=36a7fb13d1554e398c0fa58a63147893&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=1d69c101c31d486496fd3165551273f4 => generated 608 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:54.525042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:54.656874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:54.690762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8ae2c-fdd2-4e17-8056-f4870159fcd2 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:54.733489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:54.734168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:54.734452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:54.734764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:54.749362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:54.754687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:54.756857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:54.758645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 78/161] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:54.762522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:54.855320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:54.925820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56fc45-a256-401d-9091-d76ad782f121 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:54.976067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:54.976957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:54.977285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:54.977622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:54.978515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:54.978891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:54.980688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:54.999304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 84/162] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:31:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:55.006414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:55.142693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:55.159384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646838a7-eb24-4d18-be34-06024bacd3ed None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:55.265156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:55.285498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:55.286529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:55.286977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:55.287438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:55.293597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:55.296848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:55.299796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 79/163] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:55 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:55.308763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:55.405278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb35ab-dbf9-4d15-a37d-128ccaac844f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:55.452526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:55.477231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:55.478362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:55.478841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:55.479410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:55.510403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:55.529395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:55.530291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:55.531294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:55.535904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 85/164] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:55.554592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:55.698874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7bea-901f-426d-8abc-29b5dae9dffe None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:55.825935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:55.827686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:55.828233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:55.828801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:55.881200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437c4b3-7059-47aa-82ca-5451721baf4a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:55.936860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:55.941500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:55.942039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:55.942475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:55.943338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:55.943798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:55.945520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9db02-793f-481e-9b5a-547490b34eb4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:55.964954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 86/165] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:55.966308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188b9e3-9448-49af-8316-a2c1f6b3f3ad None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:55.966602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188b9e3-9448-49af-8316-a2c1f6b3f3ad None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:55.967004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188b9e3-9448-49af-8316-a2c1f6b3f3ad None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:55.968683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 87/166] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:55.977934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:55.978271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:55.978497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:56.032287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:56.035920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:56.052677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:56.062168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:56.065233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:56.118496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:56.194448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 88/167] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:56.195698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:56.322773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2ffde-d86a-4794-b74a-668cb1ebe8e2 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:56.372519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:56.373881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:56.374389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:56.374964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] PATH_INFO: `/v3/users/094fba2382e149f9b3e5ba2c3c144f8d` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:56.377716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] RBAC: Authorizing `identity:get_user(user_id=094fba2382e149f9b3e5ba2c3c144f8d)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:56.379552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:56.381576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 89/168] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:56 2022] GET /identity/v3/users/094fba2382e149f9b3e5ba2c3c144f8d => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:56.392061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:56.393176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 80/169] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1085 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:56.411815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:56.488928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:56.559206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea17bb-c022-4b19-b8ca-2aafda5698b9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:56.600428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:56.601570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:56.602085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:56.602583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:56.686078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:56.688186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:56.771632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:56.786713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:56.795112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe493-eb97-4eab-97d0-ff7823bc11ce None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:56.831436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 90/170] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:56.840161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:56.973745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:56.974795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:56.975312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:56.975815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] PATH_INFO: `/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:56.982073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] RBAC: Authorizing `identity:get_project(project_id=4aa7ba9e07ff444ba3df6ac6b02ca8e5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:56.984719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:56.988069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 81/171] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:56 2022] GET /identity/v3/projects/4aa7ba9e07ff444ba3df6ac6b02ca8e5 => generated 312 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:56.991680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:57.003615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5be3-e9bb-4f8e-a589-1adec6c1e03a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:57.051994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:57.053085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.053600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.054079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.055646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:57.057610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:57.059838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 91/172] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:56 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:31:57.065569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:57.085364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:57.212470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34faf8c-d2ff-423f-b1b2-35ff5967c9aa None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:57.272593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:57.273782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.274293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.274901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.275968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=4aa7ba9e07ff444ba3df6ac6b02ca8e5, user.id=36a7fb13d1554e398c0fa58a63147893) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:57.276752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:57.278577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:57.282629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12f141-2b3c-43a1-b0b3-9137e73e8060 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:57.286624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 92/173] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:57 2022] GET /identity/v3/role_assignments?user.id=36a7fb13d1554e398c0fa58a63147893&scope.project.id=4aa7ba9e07ff444ba3df6ac6b02ca8e5&role.id=1d69c101c31d486496fd3165551273f4 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:57.287800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:57.445310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536ceff-ec9f-48e5-bed8-eea3b9271bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:57.446476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ceff-ec9f-48e5-bed8-eea3b9271bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.446989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ceff-ec9f-48e5-bed8-eea3b9271bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.447487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ceff-ec9f-48e5-bed8-eea3b9271bf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.464826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:57.482392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536ceff-ec9f-48e5-bed8-eea3b9271bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a536ceff-ec9f-48e5-bed8-eea3b9271bf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:57.501257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:57.502299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:57.503087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:57.503716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 82/174] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:31:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:57.506413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c8962-344e-40bf-acf6-0e29d7e1e178 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.506909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c8962-344e-40bf-acf6-0e29d7e1e178 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.507410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c8962-344e-40bf-acf6-0e29d7e1e178 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.512779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 83/175] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:57.514580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c8962-344e-40bf-acf6-0e29d7e1e178 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:57.534203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830e92d-55ba-4c65-91c3-34eb7fec59c1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:57.593935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:57.596217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.597089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.598914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.599942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=094fba2382e149f9b3e5ba2c3c144f8d) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:57.600916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:57.603609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f92d-df9e-4adf-bdd4-656ba08ab1cf None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:57.616284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:57.620205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 93/176] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:57 2022] GET /identity/v3/role_assignments?user.id=094fba2382e149f9b3e5ba2c3c144f8d&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:57.625242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.626964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.628304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.679248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:57.683466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:57.832709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c8962-344e-40bf-acf6-0e29d7e1e178 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:57.886807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 94/177] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:57.929580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:57.930723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:57.931181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:57.931634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:57.932912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:57.933436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:57.936699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:57.952850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 84/178] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:31:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:57.962394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:58.078328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:58.125689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3a34-51cb-4b2a-a5e6-0f43d56b83e4 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:58.166856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e19f26-8dbb-4597-9f5d-35965c2ef77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:58.167575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19f26-8dbb-4597-9f5d-35965c2ef77a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.167856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19f26-8dbb-4597-9f5d-35965c2ef77a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.168126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19f26-8dbb-4597-9f5d-35965c2ef77a None admin] PATH_INFO: `/v3/users/36a7fb13d1554e398c0fa58a63147893` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.169449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e19f26-8dbb-4597-9f5d-35965c2ef77a None admin] RBAC: Authorizing `identity:get_user(user_id=36a7fb13d1554e398c0fa58a63147893)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:58.171786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e19f26-8dbb-4597-9f5d-35965c2ef77a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:58.173518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 95/179] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:57 2022] GET /identity/v3/users/36a7fb13d1554e398c0fa58a63147893 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:58.182353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:58.449716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:58.481954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc5b33-2bb9-4b0e-b419-80793bac0f6c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:58.507992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b492ac0-7c53-4a87-9661-d13c42ad578d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.508485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b492ac0-7c53-4a87-9661-d13c42ad578d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.508764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b492ac0-7c53-4a87-9661-d13c42ad578d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.510149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 96/180] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:58.520668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.520973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.521227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.561765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:58.562354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9c457-4f9a-4a4b-9cf5-0369de7ccefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:58.563463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c457-4f9a-4a4b-9cf5-0369de7ccefd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.563824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:58.563944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c457-4f9a-4a4b-9cf5-0369de7ccefd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.564462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9c457-4f9a-4a4b-9cf5-0369de7ccefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.677846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 97/181] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:31:58.678688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:58.713508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9c457-4f9a-4a4b-9cf5-0369de7ccefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:58.718870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9c457-4f9a-4a4b-9cf5-0369de7ccefd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:58.758496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:58.806877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4bd3b-7533-4ca2-b514-76d0734b68ba None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:58.852511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ad722-1fbb-4da7-894b-26e39d09425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:58.853166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad722-1fbb-4da7-894b-26e39d09425f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.853440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad722-1fbb-4da7-894b-26e39d09425f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.853708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad722-1fbb-4da7-894b-26e39d09425f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.863264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:58.869340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ad722-1fbb-4da7-894b-26e39d09425f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-979ad722-1fbb-4da7-894b-26e39d09425f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:58.875060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:58.877099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:58.878681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 98/182] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:58.879981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95649a8-b120-48b5-b982-5e14cf18acca None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.879981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95649a8-b120-48b5-b982-5e14cf18acca None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.879981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95649a8-b120-48b5-b982-5e14cf18acca None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.887495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 99/183] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:58.887495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83194e6b-ffb6-4619-8c72-cf2b7ada2d78 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.887495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83194e6b-ffb6-4619-8c72-cf2b7ada2d78 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.887495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83194e6b-ffb6-4619-8c72-cf2b7ada2d78 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.887495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 100/184] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:31:58.887495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83194e6b-ffb6-4619-8c72-cf2b7ada2d78 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:58.891359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 85/185] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:31:58.897476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65012a5-e4c9-4532-9e06-7be6e733fc05 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:58.897870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65012a5-e4c9-4532-9e06-7be6e733fc05 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:58.898112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65012a5-e4c9-4532-9e06-7be6e733fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:58.919196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-b65012a5-e4c9-4532-9e06-7be6e733fc05 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:58.921018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-b65012a5-e4c9-4532-9e06-7be6e733fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:59.044340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 86/186] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:59.054734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.055270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.055808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.087932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83194e6b-ffb6-4619-8c72-cf2b7ada2d78 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:59.089335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:31:59.092470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:31:59.141669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:59.167034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:59.168007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.168516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.168985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.170296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:59.170849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:59.173351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:59.196428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 101/187] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:59.197784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.229442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 87/188] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:31:59.236515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.338411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:59.427098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64403c4-50fc-4c5a-9dff-013fa2bb09f9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:59.458930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d90e2-874e-4981-89a0-a8759d24d5b2 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:59.475007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:59.475854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.476310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.476715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.478417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:59.480177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:59.482744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 102/189] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:59.483962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.536953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:59.538049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.538533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.538994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] PATH_INFO: `/v3/users/af71fbe44b334b4fa93e9cab13874cc1` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.554774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:59.560434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] RBAC: Authorizing `identity:get_user(user_id=af71fbe44b334b4fa93e9cab13874cc1)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:59.562032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:59.563846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 88/190] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/users/af71fbe44b334b4fa93e9cab13874cc1 => generated 283 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:59.564719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.635765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980446-9616-4b52-abe9-4626af5f7080 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:59.686480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:59.687484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.687922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.688342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.703864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:59.709722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82fb32-6de6-4308-80f4-5af6e8c26997 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:59.710274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:59.711968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 103/191] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:59.718025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.728193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:59.764369 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:59.765314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.765689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.766071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.779436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:31:59.784979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:31:59.787094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 89/192] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:31:59.788813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.856190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ade65-58a2-4bcd-84b6-800018c94186 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:31:59.874203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:31:59.907411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:31:59.908267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:31:59.908722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:31:59.909169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:31:59.910455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] RBAC: Adding query filter params (role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=36a7fb13d1554e398c0fa58a63147893) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:31:59.910955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:31:59.913580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:31:59.924295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 104/193] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/role_assignments?user.id=36a7fb13d1554e398c0fa58a63147893&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:31:59.925450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:31:59.934839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00a1c5-f9a5-4e47-89bc-fa177c0d04aa None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.000832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.001903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.002491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.003002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.005211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.007268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.010379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 90/194] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:00.012184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.087162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:00.121658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297b45-f9ad-42bf-8b3c-0d9f9022721b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.188078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.188740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.189071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.189398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.209007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dc3a-681e-4c29-9052-0888e233e878 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.267371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:00.283363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.284529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.285028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.285505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.286728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:00.287243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.290061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.303186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.304745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.306784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 91/195] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:00.307876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.430410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 105/196] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:00.431897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.452791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:00.458549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8863d3-2cc7-4ff8-93a3-eb23e5f48519 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.512513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.514279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.514754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.515206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.516433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:00.516978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.519610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.541010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 92/197] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:00.541010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.541921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:00.568421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd101f-3057-43f5-9d8b-b184215946fe None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.628347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.629010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.629297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.629562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.630280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.631938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.657976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 106/198] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:32:00 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:32:00.658855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.722992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b084-7390-4dc0-85ec-c32bc017565d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.781659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.782347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.782613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.782908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] PATH_INFO: `/v3/users/d01430c3559443bb9afe07782ab2e1ba` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.784194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d01430c3559443bb9afe07782ab2e1ba)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.785815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.787882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 93/199] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:00 2022] GET /identity/v3/users/d01430c3559443bb9afe07782ab2e1ba => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:00.788824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.799406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40122562-91a2-4751-8ecd-d62b0ab844e8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:00.830984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:00.847236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:00.856837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:00.860622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:00.861658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:00.862301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:00.864736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:00.867015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:00.875535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 107/200] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:00 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:00.875535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:00.975484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a6695-6906-4102-80ff-bb71797848e8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:01.044367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:01.045553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:01.045838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:01.046114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] PATH_INFO: `/v3/users/af71fbe44b334b4fa93e9cab13874cc1` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:01.047609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] RBAC: Authorizing `identity:get_user(user_id=af71fbe44b334b4fa93e9cab13874cc1)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:01.049222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:01.050415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b9411-e8c4-4f0e-b1e4-93445523fdf3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:01.053520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 94/201] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:00 2022] GET /identity/v3/users/af71fbe44b334b4fa93e9cab13874cc1 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:01.053520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:01.096505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:01.097481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:01.097755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:01.098023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:01.200214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:01.204750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:01.208187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:01.223164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:01.234808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839307fe-c262-4349-9b70-e945bad512b8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:01.288059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:01.289246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:01.290162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:01.290822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:01.292393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=af71fbe44b334b4fa93e9cab13874cc1) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:01.292949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:01.296345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:01.307721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 95/202] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:01 2022] GET /identity/v3/role_assignments?user.id=af71fbe44b334b4fa93e9cab13874cc1&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:01.309097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:01.346674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 108/203] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:01.352521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:01.553855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334011f-f446-49eb-8b75-36dacbc4c928 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:01.571587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:01.575494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ffd84-1bbf-46c3-980f-77304d3a1441 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:01.598839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:01.600072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:01.600559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:01.600901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:01.642906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:01.675602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:01.676484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:01.676770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:01.677049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:01.678437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:01.680152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:01.682380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 109/204] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:01 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:01.689006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:01.709284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:01.711515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:01.961068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 96/205] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:01.974226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:01.991452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bf5f1-a384-4407-96d0-9cf68af5682a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:02.105398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:02.106464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:02.106947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:02.107629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:02.108947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] RBAC: Adding query filter params (role.id=86898a54faa04b9983a188007dd22db9, scope.project.id=bdc04c5e3ac948a5937330bd116beba5, user.id=d01430c3559443bb9afe07782ab2e1ba) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:02.109496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:02.115504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:02.140624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 110/206] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:01 2022] GET /identity/v3/role_assignments?user.id=d01430c3559443bb9afe07782ab2e1ba&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=86898a54faa04b9983a188007dd22db9 => generated 608 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:02.176833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:02.245306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38bb7-88ec-4a68-9579-b6992c381824 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:02.302015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887c662-d30b-408f-96f8-31e92377479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:02.302709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c662-d30b-408f-96f8-31e92377479c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:02.302992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c662-d30b-408f-96f8-31e92377479c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:02.303269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c662-d30b-408f-96f8-31e92377479c None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:02.309312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887c662-d30b-408f-96f8-31e92377479c None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:02.311942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887c662-d30b-408f-96f8-31e92377479c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:02.313832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 97/207] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:01 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:02.324084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:02.406298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:02.534063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b95da-9f5b-47df-bcbe-f6ea897a80b1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:02.580576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:02.581232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:02.581509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:02.581816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:02.582543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] RBAC: Adding query filter params (role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=af71fbe44b334b4fa93e9cab13874cc1) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:02.582857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:02.584383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f912190-6408-4ad5-bae5-7c9a96a03e8d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:02.594426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 111/208] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:02 2022] GET /identity/v3/role_assignments?user.id=af71fbe44b334b4fa93e9cab13874cc1&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:04.213162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c50d4-93d1-47ca-ab4b-1812eed2f98c None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.213974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c50d4-93d1-47ca-ab4b-1812eed2f98c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.213974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c50d4-93d1-47ca-ab4b-1812eed2f98c None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.215443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 98/209] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:32:04.222194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caef94-cbff-4c0a-b316-ad33342df979 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.222932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caef94-cbff-4c0a-b316-ad33342df979 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.223239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caef94-cbff-4c0a-b316-ad33342df979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.254073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-58caef94-cbff-4c0a-b316-ad33342df979 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:04.256043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-58caef94-cbff-4c0a-b316-ad33342df979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:04.389673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 112/210] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:04.457518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186954d-614b-4c81-b593-8e581c3a8421 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.458448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186954d-614b-4c81-b593-8e581c3a8421 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.459221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186954d-614b-4c81-b593-8e581c3a8421 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.462097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 99/211] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:04.472614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade57e-7a65-4d4b-90c0-f2ade6e89ae2 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.473559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade57e-7a65-4d4b-90c0-f2ade6e89ae2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.474299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade57e-7a65-4d4b-90c0-f2ade6e89ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.508873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-23ade57e-7a65-4d4b-90c0-f2ade6e89ae2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:04.511534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-23ade57e-7a65-4d4b-90c0-f2ade6e89ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:04.554402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:04.614201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 113/212] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:04.659762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531dbd-9d59-4a63-abfb-d8f3c432c31f None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.660431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531dbd-9d59-4a63-abfb-d8f3c432c31f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.660910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531dbd-9d59-4a63-abfb-d8f3c432c31f None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.662821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 100/213] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:04.673288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349219-db11-4528-badd-d10de22832a2 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.674056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349219-db11-4528-badd-d10de22832a2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.674713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349219-db11-4528-badd-d10de22832a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.678780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14531dbd-9d59-4a63-abfb-d8f3c432c31f None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:04.699362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e4349219-db11-4528-badd-d10de22832a2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:04.701852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e4349219-db11-4528-badd-d10de22832a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:04.792358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 114/214] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:04.897325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14531dbd-9d59-4a63-abfb-d8f3c432c31f None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:04.932232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349219-db11-4528-badd-d10de22832a2 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:04.957231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:04.971836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:04.972703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:04.973139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:04.973539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:04.998103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:05.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:05.016202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:05.017021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:05.017609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 101/215] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:05.027553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.091125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:05.115386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349219-db11-4528-badd-d10de22832a2 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.172560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.173223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.173968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.174329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.188433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:05.193696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:05.194685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:05.195604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 115/216] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:05.196675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.217532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6173-ffb0-4c00-a647-3c5eb8e2ef12 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.271955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.272641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.272930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.273201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.273926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:05.274240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:05.275694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:05.286956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 102/217] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:05.287882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.343453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbdb74-66f1-4c8b-91b3-7bcea8e28dd0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.358508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:05.389800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.390458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.390736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.391004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.393715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:05.397850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:05.406661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 116/218] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:05.406661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.434689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c969ae-6a36-4273-ad8e-eb50ccfb31b1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.436439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:05.474588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.475223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.475502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.475780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.476511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:05.476816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:05.478248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:05.495722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 103/219] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:05.495722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.596029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e3ee3-d387-4a4e-a886-ee71421b1363 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.652855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.653683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.654887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.655173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] PATH_INFO: `/v3/users/af71fbe44b334b4fa93e9cab13874cc1` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.656558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] RBAC: Authorizing `identity:get_user(user_id=af71fbe44b334b4fa93e9cab13874cc1)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:05.658085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:05.660295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 117/220] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/users/af71fbe44b334b4fa93e9cab13874cc1 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:05.660638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.677446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b645-6546-4570-b9c9-01a8f5bf06ff None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.705304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:05.754092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.755864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.755864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.756232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.757542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:05.760516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:05.786910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:05.812445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 104/221] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:32:05 2022] POST /identity/v3/users => generated 297 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:32:05.813723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:05.842921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328bce-d469-46d8-a34c-461f00ce2b65 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.935773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc691118-ca3a-4ca3-a6b6-4eacdafb07ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:05.936731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691118-ca3a-4ca3-a6b6-4eacdafb07ce None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.937178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691118-ca3a-4ca3-a6b6-4eacdafb07ce None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.937557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc691118-ca3a-4ca3-a6b6-4eacdafb07ce None admin] PATH_INFO: `/v3/users/abf5b54d79ce40e6b26aeca6b1599fc0` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.960981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc691118-ca3a-4ca3-a6b6-4eacdafb07ce None admin] RBAC: Authorizing `identity:get_user(user_id=abf5b54d79ce40e6b26aeca6b1599fc0)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:05.961878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b5a6-a42b-4f49-9901-aab8de60f02e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:05.962545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc691118-ca3a-4ca3-a6b6-4eacdafb07ce None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:05.964698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 118/222] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/users/abf5b54d79ce40e6b26aeca6b1599fc0 => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:05.965809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca0d21-2a72-4f91-a2ba-50d3bdd08648 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:05.966092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca0d21-2a72-4f91-a2ba-50d3bdd08648 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:05.966373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca0d21-2a72-4f91-a2ba-50d3bdd08648 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:05.968385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 119/223] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:05.973139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca0d21-2a72-4f91-a2ba-50d3bdd08648 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:06.019533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b02ff-5651-4707-9cb5-429ed85b4720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:06.021319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b02ff-5651-4707-9cb5-429ed85b4720 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:06.021757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b02ff-5651-4707-9cb5-429ed85b4720 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:06.022231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b02ff-5651-4707-9cb5-429ed85b4720 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:06.024119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b02ff-5651-4707-9cb5-429ed85b4720 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:06.026421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b02ff-5651-4707-9cb5-429ed85b4720 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:06.030441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 105/224] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:06.031921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:06.032219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:06.032618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:06.054833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:06.056156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:06.109067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:06.179374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca0d21-2a72-4f91-a2ba-50d3bdd08648 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:06.192388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 106/225] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:06.192388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:06.265440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:06.265440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:06.265823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:06.266234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:06.287529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:06.381816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4847c9-6b14-4bb5-8c63-5072cf31eaf4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:06.427002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:06.431269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:06.459813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:06.462383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:06.463752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:06.464617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/af71fbe44b334b4fa93e9cab13874cc1/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:06.470369 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] RBAC: Authorizing `identity:create_grant(project_id=7106b93a9d784fbb986c39d8499f8652, user_id=af71fbe44b334b4fa93e9cab13874cc1, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:06.475795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:06.504829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 107/226] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:32:06 2022] PUT /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/af71fbe44b334b4fa93e9cab13874cc1/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:06.571656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:06.644311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 120/227] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:06.652361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:06.668732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:06.748991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:06.798531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b452-1361-47f9-8b5c-352c043fd664 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:06.849988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:06.850842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:06.851556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:06.851867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:06.864721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de91ff-5145-4120-acf4-9c8459300b1c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:06.866957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:06.879305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:06.881042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:06.882755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:06.884189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 108/228] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:06.892789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:06.932830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:06.933486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:06.933763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:06.934037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:06.935539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:06.937391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:06.939713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 121/229] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:06 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:06.949384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:07.019542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:07.038911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67dca-18a9-420d-9e87-2dab571b431c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:07.145581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00692fff-e1b4-4fb8-9a32-107b371901f5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:07.160038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:07.196792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:07.197416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:07.197689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:07.197940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:07.198815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=abf5b54d79ce40e6b26aeca6b1599fc0) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:07.199134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:07.201149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:07.205104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:07.205758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:07.206045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:07.206326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:07.207086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:07.207483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 122/230] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:06 2022] GET /identity/v3/role_assignments?user.id=abf5b54d79ce40e6b26aeca6b1599fc0&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=1d69c101c31d486496fd3165551273f4 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:07.207788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:07.209379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:07.239940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 109/231] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:07.249480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:07.577015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e46c84-9394-453b-96d6-909ce96992b3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:07.641771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:07.642996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:07.643491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:07.643977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] PATH_INFO: `/v3/users/af71fbe44b334b4fa93e9cab13874cc1` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:07.646268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] RBAC: Authorizing `identity:get_user(user_id=af71fbe44b334b4fa93e9cab13874cc1)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:07.649049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:07.651993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 123/232] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:07 2022] GET /identity/v3/users/af71fbe44b334b4fa93e9cab13874cc1 => generated 283 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:07.661260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:08.000405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946665e-708e-40b3-b90b-3b230f936c15 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:08.099030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23cb5-2e3d-4bd7-9666-ffbeb017e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:08.100187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23cb5-2e3d-4bd7-9666-ffbeb017e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:08.101037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23cb5-2e3d-4bd7-9666-ffbeb017e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:08.101037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23cb5-2e3d-4bd7-9666-ffbeb017e2e3 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:08.102165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23cb5-2e3d-4bd7-9666-ffbeb017e2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:08.103691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23cb5-2e3d-4bd7-9666-ffbeb017e2e3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:08.105464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 110/233] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:07 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:08.111965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:08.184286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:08.353153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a2f80-8f0d-4bc7-8dc8-e9b2f0998868 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:08.442395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355e6c-cb1a-49bd-b5b4-28201f28e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:08.442989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355e6c-cb1a-49bd-b5b4-28201f28e95e None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:08.443267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355e6c-cb1a-49bd-b5b4-28201f28e95e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:08.443541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355e6c-cb1a-49bd-b5b4-28201f28e95e None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/af71fbe44b334b4fa93e9cab13874cc1/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:08.446005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10355e6c-cb1a-49bd-b5b4-28201f28e95e None admin] RBAC: Authorizing `identity:create_grant(project_id=7106b93a9d784fbb986c39d8499f8652, user_id=af71fbe44b334b4fa93e9cab13874cc1, role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:08.447532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10355e6c-cb1a-49bd-b5b4-28201f28e95e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:08.484605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 124/234] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:32:08 2022] PUT /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/af71fbe44b334b4fa93e9cab13874cc1/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:09.202324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99554-246e-44d3-ab65-62e2a73f985f None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:09.202838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99554-246e-44d3-ab65-62e2a73f985f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:09.203244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99554-246e-44d3-ab65-62e2a73f985f None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:09.206348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 111/235] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:09.215691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:09.215691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:09.215691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:09.245956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:09.247702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:09.400301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 125/236] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:10.009438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99554-246e-44d3-ab65-62e2a73f985f None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:10.068292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:10.417807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99554-246e-44d3-ab65-62e2a73f985f None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:10.548279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77b411-6c6b-4697-8738-8dff71f965c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:10.548279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77b411-6c6b-4697-8738-8dff71f965c6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.548279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77b411-6c6b-4697-8738-8dff71f965c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.548279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77b411-6c6b-4697-8738-8dff71f965c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.585096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77b411-6c6b-4697-8738-8dff71f965c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-fd77b411-6c6b-4697-8738-8dff71f965c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:10.590788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:10.593155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:10.594663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 112/237] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 585 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:10.609049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:10.680929 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:10.710379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f885-fbf7-464a-9166-6b814486b5be None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.710654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f885-fbf7-464a-9166-6b814486b5be None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.710963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f885-fbf7-464a-9166-6b814486b5be None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.712819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 113/238] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:10.719405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41bc2-6b00-47f5-83be-2220de161292 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.719686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41bc2-6b00-47f5-83be-2220de161292 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.719997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41bc2-6b00-47f5-83be-2220de161292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.768277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-16a41bc2-6b00-47f5-83be-2220de161292 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:10.772302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-16a41bc2-6b00-47f5-83be-2220de161292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:10.889438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6719c-201c-4d80-b266-5f768fd70a9f None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:10.929943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 114/239] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:10.931588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873522b-cb6b-4fd8-883b-a236aa8e247e None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.931866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873522b-cb6b-4fd8-883b-a236aa8e247e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.932116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873522b-cb6b-4fd8-883b-a236aa8e247e None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.933844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 115/240] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:10.944279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.944279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.944279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.959114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:10.970234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:10.971812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:10.976432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:10.979098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.979098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.979435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.984276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:10.984276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:10.984276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585acf93-cb93-48fd-af08-166329c12690 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:10.992501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 126/241] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:10.994380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96a4bf-e5a4-49ca-a083-ea948d755d1c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:10.994708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96a4bf-e5a4-49ca-a083-ea948d755d1c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:10.995009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96a4bf-e5a4-49ca-a083-ea948d755d1c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:10.996677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 127/242] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:11.005850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:11.006255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:11.006443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:11.049522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:11.054652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:11.116965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 116/243] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:11.119345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:11.314109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 128/244] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:11.314737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:11.409092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:11.468496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa7306-463b-4397-83d8-90534d8c5e33 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:11.518255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:11.519204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:11.519644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:11.520076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] PATH_INFO: `/v3/users/b58c9523cdff499db9a0115e1acd0097` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:11.524008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:11.542669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] RBAC: Authorizing `identity:get_user(user_id=b58c9523cdff499db9a0115e1acd0097)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:11.547956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:11.551889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 117/245] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:11 2022] GET /identity/v3/users/b58c9523cdff499db9a0115e1acd0097 => generated 297 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:11.561737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:11.695054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6715-aca4-455c-bade-c9c666f4ddd8 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:11.722732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee6e2-a15a-45ae-9319-59feeba4a394 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:11.766283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:11.767839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:11.768320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:11.769101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:11.774572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:11.775819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:11.776300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:11.776749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:11.785339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:11.792463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:11.793402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:11.794306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:11.796551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 129/246] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 482 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:11.797430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:11.902899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:11.915075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:11.916628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:11.943158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:11.972610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d741-7e15-49a2-9f45-1f3ba89a9cc1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.043722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.044789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.045227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.045692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.067877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:12.078320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:12.080095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:12.081705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 130/247] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:12.082994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.105116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 118/248] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:12.106108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.242667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:12.251955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ccc6-b419-483c-985e-65736ab810c1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.252195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a9936-1d42-4d58-8a2f-eebc5a21d02e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.302458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.303102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.303381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.303654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.304390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:12.304725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:12.306174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:12.311178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.311837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.312114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.312436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.313727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:12.315211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:12.321130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 119/249] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:12.321424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 131/250] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:12.321581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.323554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.348570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:12.498743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78801f2-05de-4ea1-bdae-adde0929c213 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.499530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b0a3-8e68-4157-9341-e924d7fce602 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.556210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed57a-becf-4fc3-a785-ff3848ecf90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.557520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed57a-becf-4fc3-a785-ff3848ecf90c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.558109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed57a-becf-4fc3-a785-ff3848ecf90c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.558594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed57a-becf-4fc3-a785-ff3848ecf90c None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.561407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.561708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ed57a-becf-4fc3-a785-ff3848ecf90c None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:12.562493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.562974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.563475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.564225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ed57a-becf-4fc3-a785-ff3848ecf90c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:12.564761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:12.565319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:12.566974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 132/251] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:12 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:12.568063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:12.569309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e96488-36ea-4fc5-a8dd-1b7e225c9065 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.569825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e96488-36ea-4fc5-a8dd-1b7e225c9065 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.570286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e96488-36ea-4fc5-a8dd-1b7e225c9065 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.579638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 133/252] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:12.579638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e96488-36ea-4fc5-a8dd-1b7e225c9065 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.585842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 120/253] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:12.587065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.625684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:12.729941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:12.779122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e96488-36ea-4fc5-a8dd-1b7e225c9065 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.779607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9ab87-8bda-4511-b2bb-7b16d617d5f2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:12.833644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.834364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.834718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.835056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.836027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:12.838779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:12.847752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088277d-14f9-4d6e-a823-35d688dfce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:12.848753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088277d-14f9-4d6e-a823-35d688dfce71 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.849376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088277d-14f9-4d6e-a823-35d688dfce71 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.849789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088277d-14f9-4d6e-a823-35d688dfce71 None admin] PATH_INFO: `/v3/users/abf5b54d79ce40e6b26aeca6b1599fc0` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.853648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088277d-14f9-4d6e-a823-35d688dfce71 None admin] RBAC: Authorizing `identity:get_user(user_id=abf5b54d79ce40e6b26aeca6b1599fc0)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:12.856868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088277d-14f9-4d6e-a823-35d688dfce71 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:12.860992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 134/254] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:12 2022] GET /identity/v3/users/abf5b54d79ce40e6b26aeca6b1599fc0 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:12.863103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:12.863580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:12.864002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:12.876752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 121/255] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:32:12 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:32:12.878065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:12.905557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:12.907591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:13.037226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:13.062031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 135/256] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:13.063664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:13.109089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46047a-4f0e-4519-a71b-79fa21c0aa3f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:13.188461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:13.188461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:13.188461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:13.188461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:13.189056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] RBAC: Adding query filter params (role.id=86898a54faa04b9983a188007dd22db9, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=b58c9523cdff499db9a0115e1acd0097) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:13.189752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:13.193990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:13.207486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 122/257] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:12 2022] GET /identity/v3/role_assignments?user.id=b58c9523cdff499db9a0115e1acd0097&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=86898a54faa04b9983a188007dd22db9 => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:13.209526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:13.267021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:13.317749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9f593-f449-407d-8e6d-12f116745555 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:13.400622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:13.401643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:13.402889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:13.402889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] PATH_INFO: `/v3/users/af71fbe44b334b4fa93e9cab13874cc1` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:13.405382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] RBAC: Authorizing `identity:get_user(user_id=af71fbe44b334b4fa93e9cab13874cc1)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:13.408372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:13.414355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 136/258] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:13 2022] GET /identity/v3/users/af71fbe44b334b4fa93e9cab13874cc1 => generated 283 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:13.429033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:13.473828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef69f2-35da-4095-8c83-4827d0267693 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:13.601585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:13.603642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:13.604558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:13.605371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:13.608085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:13.618579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:13.626278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 123/259] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:13 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:13.628207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:13.662033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:13.750553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990b25-88b2-44eb-b0e6-38e59b7aaee3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:13.836851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:13.838240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:13.838947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:13.839969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:13.872303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:13.996974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:14.001185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:14.186919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a392fe-d514-4f39-8aad-a718ac434d69 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:14.235652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 137/260] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:14.237576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:14.300172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:14.303042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:14.304410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:14.305250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:14.351204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:14.378481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:14.380388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:14.381742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:14.389045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 124/261] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 761 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:14.390746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:14.403414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:14.627913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d58897-74f6-4d15-af43-61dee45a36bb None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:14.670729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:14.767360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:14.771908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:14.774710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:14.775513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/abf5b54d79ce40e6b26aeca6b1599fc0/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:14.785232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] RBAC: Authorizing `identity:create_grant(project_id=7106b93a9d784fbb986c39d8499f8652, user_id=abf5b54d79ce40e6b26aeca6b1599fc0, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:14.790201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:14.810892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6da81-9dc9-4a0f-9857-6f870887366c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:14.828728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 138/262] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:32:14 2022] PUT /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/abf5b54d79ce40e6b26aeca6b1599fc0/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:14.830799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:14.969691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:14.970627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:14.971276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:14.971761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:14.974489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:14.982859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:14.985796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 125/263] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:14 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 596 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:14.993876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:15.090376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d5a8-8dea-4710-a23d-d509dede1941 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:15.097741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:15.173485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:15.175047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:15.175849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:15.176654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:15.178113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:15.178940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:15.181794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:15.202131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 139/264] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:15.212006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:15.349345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584e49-65ea-4f7c-b9ec-62aed4486bcb None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:15.409605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:15.410258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:15.410540 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:15.410820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:15.413571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=af71fbe44b334b4fa93e9cab13874cc1) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:15.413571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:15.413571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:15.416171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:15.426814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 126/265] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:14 2022] GET /identity/v3/role_assignments?user.id=af71fbe44b334b4fa93e9cab13874cc1&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:15.449456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95340a82-55ba-4617-8838-46d32e9ea3fb None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:15.526599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:15.528163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:15.529310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:15.529862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] PATH_INFO: `/v3/users/af71fbe44b334b4fa93e9cab13874cc1` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:15.540148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] RBAC: Authorizing `identity:get_user(user_id=af71fbe44b334b4fa93e9cab13874cc1)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:15.540148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:15.540148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 140/266] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:15 2022] GET /identity/v3/users/af71fbe44b334b4fa93e9cab13874cc1 => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:15.548428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:15.800196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b18492-c34f-4448-ab95-8f601392d1ff None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:15.929520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:15.930589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:15.931221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:15.931836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:16.150478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:16.161997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:16.164670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:16.538424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 127/267] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 991 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:16.547067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:16.685124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:16.879165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54411-a3ca-40de-a330-f824b6d33360 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:16.972276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3913ad-75c3-4be2-bb80-3d1ea40ed744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:16.972276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3913ad-75c3-4be2-bb80-3d1ea40ed744 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:16.972276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3913ad-75c3-4be2-bb80-3d1ea40ed744 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:16.972276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3913ad-75c3-4be2-bb80-3d1ea40ed744 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:16.972927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3913ad-75c3-4be2-bb80-3d1ea40ed744 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:16.972927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3913ad-75c3-4be2-bb80-3d1ea40ed744 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:16.982473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:16.983007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 141/268] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:16 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:17.185408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:17.196669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da876b6-a1f7-4122-8459-3e8c1928f2f2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:17.247889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:17.249234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:17.249517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:17.249782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:17.250715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] RBAC: Adding query filter params (role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=af71fbe44b334b4fa93e9cab13874cc1) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:17.251171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:17.252992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f655c7-51f4-4d88-947e-288b396bc342 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:17.260155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 128/269] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:16 2022] GET /identity/v3/role_assignments?user.id=af71fbe44b334b4fa93e9cab13874cc1&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:17.871221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec55a-0824-4f73-9875-b6619d540485 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:17.872981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec55a-0824-4f73-9875-b6619d540485 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:17.872981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ec55a-0824-4f73-9875-b6619d540485 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:17.876715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 142/270] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:17.885312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578c0d-684b-4a81-bd1d-f6da8ddf4f41 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:17.885804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578c0d-684b-4a81-bd1d-f6da8ddf4f41 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:17.886300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578c0d-684b-4a81-bd1d-f6da8ddf4f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:17.931485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-e6578c0d-684b-4a81-bd1d-f6da8ddf4f41 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:17.933969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e6578c0d-684b-4a81-bd1d-f6da8ddf4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:18.106205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 129/271] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:18.319105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6f22-0be8-4ad8-930b-af09a1dfe13b None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.319579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6f22-0be8-4ad8-930b-af09a1dfe13b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.320028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6f22-0be8-4ad8-930b-af09a1dfe13b None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.322655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 143/272] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:18.333870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.334350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.334818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.377402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:18.377402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:18.387556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32efd01-18a7-4951-bf0c-04c6f7977e4d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.389062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32efd01-18a7-4951-bf0c-04c6f7977e4d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.389838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32efd01-18a7-4951-bf0c-04c6f7977e4d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.400831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 144/273] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:18.405107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ca32-cf6a-42be-ae03-fdba45702a71 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.406176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ca32-cf6a-42be-ae03-fdba45702a71 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.407029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7ca32-cf6a-42be-ae03-fdba45702a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.458836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-00a7ca32-cf6a-42be-ae03-fdba45702a71 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:18.462236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-00a7ca32-cf6a-42be-ae03-fdba45702a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:18.545518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 130/274] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:18.595113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:18.642304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:18.651821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 145/275] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:18.797158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bde2e-36b0-42fc-b1c2-13857f741c4c None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:18.833592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152427b3-92c8-4ec3-bc8a-20157481d32c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.834066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152427b3-92c8-4ec3-bc8a-20157481d32c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.834530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152427b3-92c8-4ec3-bc8a-20157481d32c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.837359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 146/276] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:32:18.848378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.848378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.848378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.875980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:18.877140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:18.877623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:18.877778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:18.878411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:18.882477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:18.901553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:18.907032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:18.907964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:18.908780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 131/277] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:18.913306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:18.934405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:19.009857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 147/278] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:19.011348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.110959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:19.152825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d949-93ac-4bf4-af32-2fd547183710 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.179128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a284a-4667-4ee6-b9e6-8f7d67bbd0aa None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.210285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:19.210926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:19.211245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:19.212538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:19.213441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:19.213928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:19.216076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:19.229573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 148/279] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:19.244423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.289316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:19.290241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:19.290525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:19.290805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:19.301239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:19.308695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:19.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:19.316181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:19.316991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 132/280] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:19.317982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.435829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4583-5a02-4a85-b56f-4a6f067799e4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.491400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f80af-0b85-49fb-a4de-be846067be03 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.492416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:19.493200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:19.493592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:19.493976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] PATH_INFO: `/v3/users/b58c9523cdff499db9a0115e1acd0097` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:19.495576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=b58c9523cdff499db9a0115e1acd0097)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:19.498518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:19.500644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 149/281] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:19 2022] GET /identity/v3/users/b58c9523cdff499db9a0115e1acd0097 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:19.502012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.560769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:19.561562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:19.562012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:19.562409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:19.564109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:19.566072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:19.568197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 133/282] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:32:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:19.569323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.590022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:19.652623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:19.672579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ed75e-732d-49ae-b914-f8276c882ec7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.730596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a69d5b-fa7e-4155-a637-df35dbdf9642 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.733800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:19.734792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:19.735258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:19.735714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:19.756311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:19.768192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:19.769815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:19.771169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 150/283] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:19.772929 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.800762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:19.801913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:19.802422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:19.802859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:19.804062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:19.804616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:19.807000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:19.831709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 134/284] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:19.831709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:19.941775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:19.965752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afab24e-6a13-4b1a-b37e-34876c528ac9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:19.994568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31341a3-0582-4195-af87-fb0d79ce9da8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:20.018526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.019463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.019860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.020282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.022272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.025097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.031395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 151/285] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:19 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:20.031395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:20.058266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.059245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.060593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.060743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.061767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.064226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.069434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:20.101855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 135/286] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:32:19 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:32:20.102974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:20.242618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260fe7-a967-4d6d-a770-cb248813bd78 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:20.306687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.307987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.308566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.309077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.311621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:20.312076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.314232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bdbff-48ef-44c1-abdc-5f70360fccc2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:20.314989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.333738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 152/287] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:20.334600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:20.385174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:20.405888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.406329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.406713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.407092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] PATH_INFO: `/v3/users/99d0332e9a7945dcbc73c72deec7afec` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.431439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] RBAC: Authorizing `identity:get_user(user_id=99d0332e9a7945dcbc73c72deec7afec)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.433172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.435932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 136/288] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:20 2022] GET /identity/v3/users/99d0332e9a7945dcbc73c72deec7afec => generated 293 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:20.441861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:20.506712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:20.551008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8a07b-62ed-47d8-9e22-f08ce124ee1a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:20.641998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.646199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.646554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.646893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/b58c9523cdff499db9a0115e1acd0097/roles/86898a54faa04b9983a188007dd22db9` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.649410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] RBAC: Authorizing `identity:create_grant(project_id=7106b93a9d784fbb986c39d8499f8652, user_id=b58c9523cdff499db9a0115e1acd0097, role_id=86898a54faa04b9983a188007dd22db9)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.650902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.672273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d109-a223-4c55-a9ec-f648fba44880 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:20.679865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 153/289] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:32:20 2022] PUT /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652/users/b58c9523cdff499db9a0115e1acd0097/roles/86898a54faa04b9983a188007dd22db9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:20.683225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:20.817669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.817669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.817669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.817669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] PATH_INFO: `/v3/users/abf5b54d79ce40e6b26aeca6b1599fc0` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.823537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] RBAC: Authorizing `identity:get_user(user_id=abf5b54d79ce40e6b26aeca6b1599fc0)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.823537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.823819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 137/290] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:20 2022] GET /identity/v3/users/abf5b54d79ce40e6b26aeca6b1599fc0 => generated 297 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:20.832833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:20.866465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548f2e-02e2-4c35-a3fc-1298c76d1953 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:20.955323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:20.957397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:20.958033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:20.958497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:20.959504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, user.id=99d0332e9a7945dcbc73c72deec7afec, scope.system=all) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:20.962017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:20.964031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:20.976168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 154/291] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Oct 28 09:32:20 2022] GET /identity/v3/role_assignments?user.id=99d0332e9a7945dcbc73c72deec7afec&scope.system=all&role.id=1d69c101c31d486496fd3165551273f4 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:20.989048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:21.115720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d755a-0635-44b8-bbef-d038087c386a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:21.202071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:21.202980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:21.203377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:21.203758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:21.375185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:21.380276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:21.514156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:21.703485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 138/292] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 870 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:21.711977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:21.743443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:22.100008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fba69-0077-4f3a-aeef-5bc60095c1f4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:22.213920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38fa5-717d-4e66-bfb0-0c14711700df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:22.214857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38fa5-717d-4e66-bfb0-0c14711700df None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:22.215642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38fa5-717d-4e66-bfb0-0c14711700df None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:22.216630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38fa5-717d-4e66-bfb0-0c14711700df None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:22.221627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba38fa5-717d-4e66-bfb0-0c14711700df None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:22.224000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba38fa5-717d-4e66-bfb0-0c14711700df None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:22.226693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 155/293] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:21 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:22.241935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:22.563531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3750-6311-4b99-bed7-0b46ad723e12 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:22.662084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:22.662638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:22.662920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:22.663197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:22.663965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=abf5b54d79ce40e6b26aeca6b1599fc0) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:22.664311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:22.666449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69ca1f-e7ca-4a18-b1a1-08104fe23447 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:22.682596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 139/294] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:22 2022] GET /identity/v3/role_assignments?user.id=abf5b54d79ce40e6b26aeca6b1599fc0&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=1d69c101c31d486496fd3165551273f4 => generated 608 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:24.668392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94603e-f603-4444-b5ce-3445e6bf3d52 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:24.668392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94603e-f603-4444-b5ce-3445e6bf3d52 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:24.668392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94603e-f603-4444-b5ce-3445e6bf3d52 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:24.670219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 156/295] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:24.678275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de63e-2394-45de-807f-19d686700349 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:24.679033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de63e-2394-45de-807f-19d686700349 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:24.679256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de63e-2394-45de-807f-19d686700349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:24.718731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3c5de63e-2394-45de-807f-19d686700349 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:24.721118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3c5de63e-2394-45de-807f-19d686700349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:24.752811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:24.879281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 140/296] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:25.130946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e12d5-9090-4dac-b00b-7786c44f21cd None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.131497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e12d5-9090-4dac-b00b-7786c44f21cd None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.131887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e12d5-9090-4dac-b00b-7786c44f21cd None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.134751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 157/297] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:25.147316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70041f-e357-41ea-8410-0158a0508359 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.147781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70041f-e357-41ea-8410-0158a0508359 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.148287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70041f-e357-41ea-8410-0158a0508359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.161769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc6279-53e6-4b0b-893a-8df761a0fa71 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.162255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc6279-53e6-4b0b-893a-8df761a0fa71 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.162715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc6279-53e6-4b0b-893a-8df761a0fa71 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.165868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 158/298] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:25.180748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.181661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.182376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.207534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3f70041f-e357-41ea-8410-0158a0508359 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:25.207534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3f70041f-e357-41ea-8410-0158a0508359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:25.227652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:25.229873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:25.378820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 141/299] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:25.381620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7487e7-fab5-4992-99d0-dc46699f07f5 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.382387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7487e7-fab5-4992-99d0-dc46699f07f5 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.383149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7487e7-fab5-4992-99d0-dc46699f07f5 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.386032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 142/300] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:25.401113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 159/301] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:25.404147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.404909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.405600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.439090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:25.441883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:25.536566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:25.551589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:25.591866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 143/302] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:25.835366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e509ca-7550-4766-bb33-25e2182b9d9e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:25.909258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:25.910493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:25.911144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:25.911831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:25.934006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:25.944321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:25.946071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:25.947604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:25.951987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:25.952761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 160/303] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:25.961997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.016756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:26.105560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:26.197462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0c6c2-ef3c-43a1-b055-4b76de777d8f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.217522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9618d6-0c9a-4ab5-ab7a-88ebfb9cdd77 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.251328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:26.252055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:26.252353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:26.252838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:26.253547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:26.253854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:26.255272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:26.271592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:26.272271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:26.272566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:26.272837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:26.279356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 161/304] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:26.279356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.296589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:26.303808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:26.304907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:26.305708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:26.308127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 144/305] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:26.310093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.437290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:26.441601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e51cc4-709e-49a8-a9ee-05445bd24ce0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.483197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25107283-8d33-4a82-ba77-722a91d643a5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.488284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:26.504487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:26.505319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:26.505787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:26.506220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:26.507686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:26.509682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:26.512007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 162/306] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:26.513420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.531914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:26.532633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:26.532916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:26.533187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:26.546180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:26.551245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:26.552314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:26.553217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 145/307] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:26.557798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.686006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a3b68-9e8d-4141-a0ca-022a6b8e6757 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.699143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1faa1-b70b-4166-8679-b5e0cead8f1b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.731298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:26.733002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:26.733462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:26.733914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] PATH_INFO: `/v3/users/6aedac7c5b9e4047954e31e6b38decb6` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:26.738470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:26.749132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:26.750037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:26.750461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:26.750871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:26.751696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:26.752173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:26.753632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:26.760741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] RBAC: Authorizing `identity:get_user(user_id=6aedac7c5b9e4047954e31e6b38decb6)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:26.763323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:26.763920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 146/308] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:26.773754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 163/309] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:26 2022] GET /identity/v3/users/6aedac7c5b9e4047954e31e6b38decb6 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:26.773754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.774121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:26.869461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:26.950016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce8c6-aa1d-4568-ba18-4e9e4b395b6d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:26.960863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff406fa-de2a-4de8-916d-834f08c41c72 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:27.015130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:27.016168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:27.016669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:27.017132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] PATH_INFO: `/v3/groups` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:27.018339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:27.020842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:27.034911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:27.036158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:27.036745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:27.037396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:27.038674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:27.039399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:27.043155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:27.050893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 147/310] 10.222.0.44 () {60 vars in 1134 bytes} [Fri Oct 28 09:32:26 2022] POST /identity/v3/groups => generated 229 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:32:27.061204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:27.061439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 164/311] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:27.061439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:27.148939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:27.251482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2cd8-dd28-496e-bbdb-5b6e8a31e643 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:27.264936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7b390-730e-47b9-a661-1629ea114f63 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:27.293504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:27.331464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:27.332030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:27.332386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:27.332656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:27.333392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] RBAC: Adding query filter params (role.id=86898a54faa04b9983a188007dd22db9, user.id=6aedac7c5b9e4047954e31e6b38decb6, scope.system=all) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:27.333731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:27.335189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:27.339860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:27.341429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:27.341895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:27.342393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] PATH_INFO: `/v3/users/b58c9523cdff499db9a0115e1acd0097` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:27.346229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 165/312] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Oct 28 09:32:27 2022] GET /identity/v3/role_assignments?user.id=6aedac7c5b9e4047954e31e6b38decb6&scope.system=all&role.id=86898a54faa04b9983a188007dd22db9 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:27.346477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] RBAC: Authorizing `identity:get_user(user_id=b58c9523cdff499db9a0115e1acd0097)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:27.346621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:27.347867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:27.352479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 148/313] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:27 2022] GET /identity/v3/users/b58c9523cdff499db9a0115e1acd0097 => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:27.361359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:27.738881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc73dee-5b4e-4588-bba3-c408d9611cf9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:27.787221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5388fad-5f0f-43e0-9d53-7efae3a52808 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:27.844051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:27.897780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:27.899084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:27.899764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:27.900109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:27.944872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:27.945951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:27.946377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:27.946864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] PATH_INFO: `/v3/users/99d0332e9a7945dcbc73c72deec7afec` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:27.952369 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] RBAC: Authorizing `identity:get_user(user_id=99d0332e9a7945dcbc73c72deec7afec)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:27.955098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:27.959713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 166/314] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:27 2022] GET /identity/v3/users/99d0332e9a7945dcbc73c72deec7afec => generated 293 bytes in 615 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:27.966658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:28.156707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:28.185308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:28.188097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:28.317186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c240fc-1330-439b-8c34-3dcf29d1a305 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:28.402532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:28.405242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:28.406339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:28.407144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] PATH_INFO: `/v3/system/users/99d0332e9a7945dcbc73c72deec7afec/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:28.410697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=99d0332e9a7945dcbc73c72deec7afec, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:28.413871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:28.420827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 149/315] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1060 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:28.428626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:28.438277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 167/316] 10.222.0.44 () {58 vars in 1334 bytes} [Fri Oct 28 09:32:27 2022] PUT /identity/v3/system/users/99d0332e9a7945dcbc73c72deec7afec/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:28.472949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:28.650347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5d06-9cfd-4e73-93a2-358bce8e1978 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:28.725773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be4748-99cc-423c-a753-feb060f0714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:28.726333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4748-99cc-423c-a753-feb060f0714e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:28.726611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4748-99cc-423c-a753-feb060f0714e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:28.726884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4748-99cc-423c-a753-feb060f0714e None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:28.728219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be4748-99cc-423c-a753-feb060f0714e None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:28.729767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be4748-99cc-423c-a753-feb060f0714e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:28.733125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 150/317] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:28 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:28.741997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:28.870608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbb5f-4264-4ead-8aa3-233bb558ec99 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:28.883943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:28.926864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:28.927497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:28.928130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:28.928441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:28.929212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] RBAC: Adding query filter params (role.id=86898a54faa04b9983a188007dd22db9, scope.project.id=7106b93a9d784fbb986c39d8499f8652, user.id=b58c9523cdff499db9a0115e1acd0097) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:28.929522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:28.931019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e464-4831-443d-81f5-d0746265d8f3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:28.939160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 168/318] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:32:28 2022] GET /identity/v3/role_assignments?user.id=b58c9523cdff499db9a0115e1acd0097&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=86898a54faa04b9983a188007dd22db9 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:30.319990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae16ff-a135-44ca-a5a3-37e85bd9ef5c None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.320826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae16ff-a135-44ca-a5a3-37e85bd9ef5c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.320972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae16ff-a135-44ca-a5a3-37e85bd9ef5c None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.323296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 151/319] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:30.329948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.330720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.330720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.351918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:30.353200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:30.366041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f7f1-794a-4e81-950a-2aab6834415a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.366478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f7f1-794a-4e81-950a-2aab6834415a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.366928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f7f1-794a-4e81-950a-2aab6834415a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.368620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 152/320] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:30.376736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895277-68e9-42fd-9f64-758b44193683 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.377374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895277-68e9-42fd-9f64-758b44193683 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.377728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895277-68e9-42fd-9f64-758b44193683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.402485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-80895277-68e9-42fd-9f64-758b44193683 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:30.405096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-80895277-68e9-42fd-9f64-758b44193683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:30.444772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 169/321] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:30.502875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 153/322] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:30.730743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:30.789290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80895277-68e9-42fd-9f64-758b44193683 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:30.812489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:30.862890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f473e9-f3cc-4694-9896-f0c1c5b093ce None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:30.865647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:30.902572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37edd0-08bd-439e-b50d-8a025d807127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:30.903431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37edd0-08bd-439e-b50d-8a025d807127 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.903822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37edd0-08bd-439e-b50d-8a025d807127 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.904345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37edd0-08bd-439e-b50d-8a025d807127 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.913948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80895277-68e9-42fd-9f64-758b44193683 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:30.916153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37edd0-08bd-439e-b50d-8a025d807127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-1f37edd0-08bd-439e-b50d-8a025d807127 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:30.922276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:30.923597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:30.924546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 170/323] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:30.925292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe03868-891f-48d2-8c16-e67a679039da None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.925292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe03868-891f-48d2-8c16-e67a679039da None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.925292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe03868-891f-48d2-8c16-e67a679039da None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.932188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 171/324] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:30.932188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe03868-891f-48d2-8c16-e67a679039da None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:30.971084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea805e4-7688-4385-9b2b-2dfdc22be864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:30.971811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea805e4-7688-4385-9b2b-2dfdc22be864 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.972115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea805e4-7688-4385-9b2b-2dfdc22be864 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.972431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea805e4-7688-4385-9b2b-2dfdc22be864 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.973814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea805e4-7688-4385-9b2b-2dfdc22be864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:30.975300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea805e4-7688-4385-9b2b-2dfdc22be864 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:30.977000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 154/325] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:32:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:30.978328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:30.978620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:30.978903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:30.998525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:30.999675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:31.081235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 155/326] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:31.082459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:31.098063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe03868-891f-48d2-8c16-e67a679039da None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:31.108617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:31.150585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:31.151320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:31.151649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:31.151909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:31.152784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:31.153035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:31.154802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:31.166483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 172/327] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:31.172983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:31.214079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:31.231915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3509c-b103-484b-a17f-efc72442c6fa None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:31.281631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:31.282184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:31.282464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:31.282739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] PATH_INFO: `/v3/groups` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:31.283391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:31.285087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:31.320283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 156/328] 10.222.0.44 () {60 vars in 1134 bytes} [Fri Oct 28 09:32:31 2022] POST /identity/v3/groups => generated 226 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:32:31.328168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca776-bda1-442b-8e0c-79d1237a6534 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:31.394289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:31.395407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:31.395791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:31.396323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] PATH_INFO: `/v3/users/6aedac7c5b9e4047954e31e6b38decb6` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:31.398086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] RBAC: Authorizing `identity:get_user(user_id=6aedac7c5b9e4047954e31e6b38decb6)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:31.399930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:31.402441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 173/329] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:31 2022] GET /identity/v3/users/6aedac7c5b9e4047954e31e6b38decb6 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:31.408836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:31.507160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:31.541354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09095-79fa-4d75-9f1e-23a59479de5f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:31.589044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:31.590237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:31.591355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:31.591867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] PATH_INFO: `/v3/system/users/6aedac7c5b9e4047954e31e6b38decb6/roles/86898a54faa04b9983a188007dd22db9` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:31.594832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6aedac7c5b9e4047954e31e6b38decb6, role_id=86898a54faa04b9983a188007dd22db9)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:31.597599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:31.611500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 157/330] 10.222.0.44 () {58 vars in 1334 bytes} [Fri Oct 28 09:32:31 2022] PUT /identity/v3/system/users/6aedac7c5b9e4047954e31e6b38decb6/roles/86898a54faa04b9983a188007dd22db9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:32:31.613311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:31.760278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:31.775025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968a2bd-f3d3-4aaa-ba33-16ab94100f49 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:31.844801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:31.845925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:31.846413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:31.846878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:31.868803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:31.881228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:31.882185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:31.883056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:31.883676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 174/331] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:31.894010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:32.064617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b87bd-8b0f-4ca7-a0b7-bf00c7a239ee None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:32.143094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:32.144664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:32.145417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:32.146217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:32.147740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:32.148599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:32.151489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:32.165947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:32.177021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 158/332] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:32.189328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:32.411646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8c657-a2eb-42d2-b6f9-ce2b43eec9a1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:32.491719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0db33-6d94-415b-9937-c61faa7f14e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:32.492802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0db33-6d94-415b-9937-c61faa7f14e3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:32.493278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0db33-6d94-415b-9937-c61faa7f14e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:32.493760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0db33-6d94-415b-9937-c61faa7f14e3 None admin] PATH_INFO: `/v3/users/99d0332e9a7945dcbc73c72deec7afec` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:32.495907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0db33-6d94-415b-9937-c61faa7f14e3 None admin] RBAC: Authorizing `identity:get_user(user_id=99d0332e9a7945dcbc73c72deec7afec)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:32.498831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0db33-6d94-415b-9937-c61faa7f14e3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:32.502463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 175/333] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:32 2022] GET /identity/v3/users/99d0332e9a7945dcbc73c72deec7afec => generated 293 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:32.511921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:32.759708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39f92-840b-4cf7-be36-6288c6520b19 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:32.830199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:32.831775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:32.832566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:32.833319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:32.834982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] RBAC: Adding query filter params (role.id=1d69c101c31d486496fd3165551273f4, user.id=99d0332e9a7945dcbc73c72deec7afec, scope.system=all) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:32.835908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:32.839018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7cb8b-190d-4758-b1a8-f65bc5f3d71a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:32.866275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 159/334] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Oct 28 09:32:32 2022] GET /identity/v3/role_assignments?user.id=99d0332e9a7945dcbc73c72deec7afec&scope.system=all&role.id=1d69c101c31d486496fd3165551273f4 => generated 510 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:35.054311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b7fa-e9b7-4527-800b-cd42e60597c0 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:35.054825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b7fa-e9b7-4527-800b-cd42e60597c0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:35.054897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b7fa-e9b7-4527-800b-cd42e60597c0 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:35.056367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 176/335] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:35.065621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f73e-7512-4d84-84be-081ac89d91aa None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:35.066596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f73e-7512-4d84-84be-081ac89d91aa None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:35.067070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f73e-7512-4d84-84be-081ac89d91aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:35.093717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6631f73e-7512-4d84-84be-081ac89d91aa None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:35.095299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6631f73e-7512-4d84-84be-081ac89d91aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:35.182147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:35.219006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 160/336] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:35.485237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135769cf-6541-4520-8070-fc8c81ddb1be None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:35.486343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135769cf-6541-4520-8070-fc8c81ddb1be None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:35.487122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135769cf-6541-4520-8070-fc8c81ddb1be None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:35.490108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 177/337] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:35.496843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:35.498465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:35.499193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:35.536774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:35.539509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:35.695054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858190e-7eda-4256-a4b9-472b2031dbb7 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:35.696011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858190e-7eda-4256-a4b9-472b2031dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:35.697007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858190e-7eda-4256-a4b9-472b2031dbb7 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:35.699936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 178/338] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:32:35.703663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 161/339] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:35.713254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:35.714117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:35.714786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:35.753006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:35.755600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:35.792830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:35.874416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 179/340] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:35.995513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:36.133634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7798c-ea6a-4724-a687-adfdac312c28 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:36.165576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:36.186443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:36.187107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:36.187386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:36.187657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:36.209496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:36.214896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:36.217776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:36.219205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 162/341] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:36.230117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:36.382265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58048b-9979-4b19-a488-060c5f5d3d1b None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:36.439037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:36.439707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:36.440134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:36.440485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:36.441217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:36.441583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:36.443009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:36.454184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 180/342] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:36.463910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:36.466203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:36.509036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:36.630543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97692e-3e90-43d1-bd03-d42a43be9253 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:36.689234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:36.689887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:36.690166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:36.690437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:36.708584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:36.714168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:36.716597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 181/343] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:36.719615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:36.752664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048db56-57e1-4f2c-8048-15703775df72 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:36.852888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:36.883036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:36.883579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:36.883866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:36.884149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:36.926386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d18d-b1eb-4b28-94ae-46c9e6062712 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:37.002638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:37.003731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:37.004192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:37.004833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:37.006169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:37.021887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:37.036054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:37.038287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 182/344] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:37.040573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:37.069116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:37.072378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:37.201647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29b3a4-abe1-4a4e-9d0c-a52b5377f605 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:37.251931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:37.252902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:37.252902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:37.253182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:37.253801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:37.254107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:37.255509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:37.257135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:37.271612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 183/345] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:37.276280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:37.296655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 163/346] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:37.296655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:37.504430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce4358-be76-4550-bc14-8dcac97aaca3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:37.519500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:37.573665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2df474-8af0-4467-9c47-dde9197db8f4 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:37.584102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:37.585388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:37.585962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:37.586549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:37.587932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:37.588635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:37.592291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:37.610242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 184/347] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:37.611939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:37.647455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c192ab-f2bf-4811-8544-de9d601051b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:37.648837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c192ab-f2bf-4811-8544-de9d601051b1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:37.649470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c192ab-f2bf-4811-8544-de9d601051b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:37.650166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c192ab-f2bf-4811-8544-de9d601051b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:37.753291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:37.789822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c192ab-f2bf-4811-8544-de9d601051b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:37.793409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c192ab-f2bf-4811-8544-de9d601051b1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:37.856780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1fb5-f34b-4033-97d9-c271b3193e54 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:37.933736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac789b7-39d0-4d84-a883-f92e5d5851b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:37.935896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac789b7-39d0-4d84-a883-f92e5d5851b3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:37.940096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac789b7-39d0-4d84-a883-f92e5d5851b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:37.940096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac789b7-39d0-4d84-a883-f92e5d5851b3 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:37.941148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac789b7-39d0-4d84-a883-f92e5d5851b3 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:37.943802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac789b7-39d0-4d84-a883-f92e5d5851b3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:37.947654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 185/348] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:37 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:37.953705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d28f-d301-4797-8aab-2b24f97e8a2a None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:37.954019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d28f-d301-4797-8aab-2b24f97e8a2a None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:37.954261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d28f-d301-4797-8aab-2b24f97e8a2a None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:37.956023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 186/349] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:37.956878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d28f-d301-4797-8aab-2b24f97e8a2a None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:37.970593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:38.010749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 164/350] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:38.021642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193209-8822-4612-a795-11f4b70b19b7 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.022031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193209-8822-4612-a795-11f4b70b19b7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.022205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193209-8822-4612-a795-11f4b70b19b7 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.023872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 165/351] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:38.024518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193209-8822-4612-a795-11f4b70b19b7 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:38.133152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d28f-d301-4797-8aab-2b24f97e8a2a None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:38.175665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:38.192776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193209-8822-4612-a795-11f4b70b19b7 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:38.198463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18fd97-a321-49c7-b2ae-85aea3f37393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:38.199492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18fd97-a321-49c7-b2ae-85aea3f37393 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.200060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18fd97-a321-49c7-b2ae-85aea3f37393 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.200580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18fd97-a321-49c7-b2ae-85aea3f37393 None admin] PATH_INFO: `/v3/users/6aedac7c5b9e4047954e31e6b38decb6` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.202314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18fd97-a321-49c7-b2ae-85aea3f37393 None admin] RBAC: Authorizing `identity:get_user(user_id=6aedac7c5b9e4047954e31e6b38decb6)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:38.204026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18fd97-a321-49c7-b2ae-85aea3f37393 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:38.207118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 187/352] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:32:37 2022] GET /identity/v3/users/6aedac7c5b9e4047954e31e6b38decb6 => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:38.208838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae334e5-a320-43a8-b1d9-5f38dc5f5f9d None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.209311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae334e5-a320-43a8-b1d9-5f38dc5f5f9d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.209764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae334e5-a320-43a8-b1d9-5f38dc5f5f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.239975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-dae334e5-a320-43a8-b1d9-5f38dc5f5f9d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:38.241953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-dae334e5-a320-43a8-b1d9-5f38dc5f5f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:38.252803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:38.253790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.254249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.254715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.265777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:38.268076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:38.272347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 166/353] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:38 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:38.273694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:38.357269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 188/354] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:38.360352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.364934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.365807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.371267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:38.396221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:38.398452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:38.489006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e04ce-a4c7-4e75-a9f6-95ceaf1adc4d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:38.533985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:38.534219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 189/355] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:38.535094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.535573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.536041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:38.536150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.537626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:38.539345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:38.542055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 167/356] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:38 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:38.548272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:38.668378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:38.700921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e4c4-6aca-4108-9dde-0d2a5a9bb8dc None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:38.713830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:38.748273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:38.749367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.749857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.750551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.751765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=bdc04c5e3ac948a5937330bd116beba5) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:38.752344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:38.754070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:38.754192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbe5a-0322-424e-8dde-1344017c0a62 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:38.763134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 168/357] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:38 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=1d69c101c31d486496fd3165551273f4 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:38.764579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:38.812744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:38.813586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:38.813874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:38.814153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:38.816044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] RBAC: Adding query filter params (role.id=86898a54faa04b9983a188007dd22db9, user.id=6aedac7c5b9e4047954e31e6b38decb6, scope.system=all) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:38.816044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:38.817606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:38.835773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 190/358] 10.222.0.44 () {56 vars in 1308 bytes} [Fri Oct 28 09:32:38 2022] GET /identity/v3/role_assignments?user.id=6aedac7c5b9e4047954e31e6b38decb6&scope.system=all&role.id=86898a54faa04b9983a188007dd22db9 => generated 510 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:38.840274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:38.987170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0fc9-e7b4-4978-8fb1-81e43d3ee9de None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:38.995373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba53f-e69b-4c55-a710-2df1282917c7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:39.015256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:39.058808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283f42b-1304-4557-9f29-c6036a206345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:39.062991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f42b-1304-4557-9f29-c6036a206345 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.063430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f42b-1304-4557-9f29-c6036a206345 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.063911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f42b-1304-4557-9f29-c6036a206345 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.068513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29071496-59c9-4bf3-a87d-ace110ccc03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:39.069552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29071496-59c9-4bf3-a87d-ace110ccc03b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.069971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29071496-59c9-4bf3-a87d-ace110ccc03b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.070368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29071496-59c9-4bf3-a87d-ace110ccc03b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.072556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283f42b-1304-4557-9f29-c6036a206345 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:39.078588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283f42b-1304-4557-9f29-c6036a206345 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:39.083368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 169/359] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:38 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:39.091407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e459a01-a470-4e55-b506-bac1767500fe None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.091653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e459a01-a470-4e55-b506-bac1767500fe None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.094332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e459a01-a470-4e55-b506-bac1767500fe None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.095821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 170/360] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:39.101285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e459a01-a470-4e55-b506-bac1767500fe None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:39.113164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29071496-59c9-4bf3-a87d-ace110ccc03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-29071496-59c9-4bf3-a87d-ace110ccc03b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:39.124903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:39.125873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:39.126664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:39.129435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 191/361] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:39.131119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.131677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.132188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.158589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:39.160532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:39.189326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:39.277604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e459a01-a470-4e55-b506-bac1767500fe None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:39.294783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 192/362] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:39.296038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:39.365782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:39.366449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.366724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.369392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.372171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=bdc04c5e3ac948a5937330bd116beba5) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:39.375011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:39.380895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:39.398505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 171/363] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:39 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 260 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:39.400921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:39.466081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae953f-93f2-40b8-bbe6-9f681031e1c6 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:39.470443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:39.552648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:39.556440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.557512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.558489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.562070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:39.564597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:39.566205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:39.586043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 193/364] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:39.594627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:39.616460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7000d1-b883-4e1a-9773-3499191a9ffd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:39.635828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:39.734614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:39.734860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.735176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.735650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.742979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e144743-2b77-4428-ace4-4a719f37dce8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:39.778863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:39.791949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:39.793007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:39.794196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 172/365] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:39.795449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:39.797098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:39.798060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:39.798709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:39.799544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:39.857132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:39.923188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:39.924964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:39.967276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aa01d-cd70-4d88-b747-ec9ec869eced None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:40.059777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:40.061396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:40.061889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:40.062363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:40.083506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:40.090379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:40.091437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:40.092367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 173/366] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:40.093161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:40.101176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 194/367] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:40.102700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:40.134503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:40.228071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae050-5ae6-4b94-b98c-0f174a1f1d19 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:40.239166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:40.271537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:40.271893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:40.272188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:40.272492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:40.273212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:40.273526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:40.275002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:40.285684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 174/368] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:40.286571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:40.323373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2e94-386f-4162-9715-2160f31b01c3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:40.400172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:40.401600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:40.402230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:40.405778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:40.406696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:40.408360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:40.409122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:40.413318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:40.419380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823defeb-5a54-40a8-8506-2eab920a168e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:40.432416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 195/369] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:40.434864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:40.469674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:40.470349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:40.470632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:40.470910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:40.472377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:40.474222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:40.476156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 175/370] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:40 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:40.477042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:40.601452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df9ca-0d72-44f1-86bf-b4236dd90c21 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:40.642140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:40.642785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:40.643068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:40.643343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:40.650098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542854b7-1e1a-4de3-9b37-88bd2d074cf7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:40.673959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:40.708486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:40.726341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:40.727807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:40.728594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:40.729387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:40.733206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:40.734752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:40.858291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 176/371] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:40.859201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:40.874608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:40.877943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:40.931902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:40.986263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28912559-d764-43b2-b06e-f01df9209007 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.026848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:41.027508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:41.027791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:41.028937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:41.029879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:41.031361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:41.033875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 177/372] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:40 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:41.034352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:41.088665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 196/373] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:41.091233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:41.148589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:41.167923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479e9a2-dd23-4b28-922e-f72bfb57e531 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.197226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:41.234152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:41.235207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:41.235676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:41.236139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] PATH_INFO: `/v3/projects/4a3fbfe9961948fb97255019ee76e43a` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:41.240837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a3fbfe9961948fb97255019ee76e43a)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:41.244019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:41.248262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 178/374] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:41 2022] GET /identity/v3/projects/4a3fbfe9961948fb97255019ee76e43a => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:41.249728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:41.329924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a0cf3-e835-4a60-b307-91d45d931b32 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.394645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:41.395625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:41.396090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:41.396614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:41.397923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=7106b93a9d784fbb986c39d8499f8652) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:41.398455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:41.401023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:41.414456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 197/375] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:41 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=1d69c101c31d486496fd3165551273f4 => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:41.415900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:41.500858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebf368-f82e-4ad8-bbb0-8efa3ef76dd5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.572422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:41.573500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:41.573976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:41.574452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:41.577594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:41.580376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:41.583387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 179/376] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:41 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:41.593468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:41.629948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:41.655398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fe98-1273-4a71-b5ba-552fe7a11164 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.726778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:41.727980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:41.728607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:41.729176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] PATH_INFO: `/v3/groups/f0c1abf4a5be4d88a9f26740850fa5b7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:41.748058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:41.753841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] RBAC: Authorizing `identity:get_group(group_id=f0c1abf4a5be4d88a9f26740850fa5b7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:41.756569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:41.760980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 198/377] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:41 2022] GET /identity/v3/groups/f0c1abf4a5be4d88a9f26740850fa5b7 => generated 229 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:41.768818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:41.881095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1b223-f9ad-4468-b90e-b3b2f9cabc9a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.967236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335039c-5191-43cc-b3db-399c52576f55 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:41.983788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:41.985083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:41.985555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:41.986019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:41.988080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:41.991332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:41.998106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 180/378] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:41 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:42.011676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:42.017974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:42.018888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:42.019329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:42.019871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:42.021975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] RBAC: Adding query filter params (group.id=f0c1abf4a5be4d88a9f26740850fa5b7, role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=4a3fbfe9961948fb97255019ee76e43a) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:42.021975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:42.022491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea685-ad4a-4ac0-8e00-f8993e6f89d4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:42.030095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 199/379] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:41 2022] GET /identity/v3/role_assignments?group.id=f0c1abf4a5be4d88a9f26740850fa5b7&scope.project.id=4a3fbfe9961948fb97255019ee76e43a&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:42.253696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef828-f2c0-4eed-a668-da93fb2ba696 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:42.315011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:42.329318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:42.330383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:42.330911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:42.331353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:42.332797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=7106b93a9d784fbb986c39d8499f8652) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:42.333350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:42.336135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e71f-2316-4b8e-9b47-480f5c0c8a2b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:42.347494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 181/380] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:42 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 260 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:42.523989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bac32-a3ff-457e-9692-0e7955681cb3 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:42.524730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bac32-a3ff-457e-9692-0e7955681cb3 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:42.525212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bac32-a3ff-457e-9692-0e7955681cb3 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:42.527283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 200/381] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:42.534562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f355f9-032c-49b0-bfb3-68457a06756d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:42.535134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f355f9-032c-49b0-bfb3-68457a06756d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:42.535527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f355f9-032c-49b0-bfb3-68457a06756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:42.584332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-f3f355f9-032c-49b0-bfb3-68457a06756d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:42.586479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f3f355f9-032c-49b0-bfb3-68457a06756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:42.702766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 182/382] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:42.873583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d67421-17fa-4a09-b324-948a343a9d88 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:42.875086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d67421-17fa-4a09-b324-948a343a9d88 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:42.875845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d67421-17fa-4a09-b324-948a343a9d88 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:42.878731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 201/383] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:42.884904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:42.885297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:42.885466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:42.909333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:42.910565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:43.027043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 183/384] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:43.207196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d67421-17fa-4a09-b324-948a343a9d88 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:43.234952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:43.353731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d67421-17fa-4a09-b324-948a343a9d88 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:43.413718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:43.414421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:43.414705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:43.414976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:43.439864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:43.445266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:43.446311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:43.447127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 202/385] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:43.456025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:43.541025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:43.604468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f4e3-e421-4fa4-967a-7e1bcbd6ff52 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:43.651889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:43.662370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:43.663021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:43.663305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:43.663586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:43.664319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:43.664646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:43.666348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:43.680609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 184/386] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:43.689496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:43.824840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:43.874360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea9dc-7c2b-4974-b568-81cea60ec6a1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:43.900805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f57a9-0093-4300-94c7-e864e5bc60aa None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:43.932280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:43.940595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:43.941336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:43.941687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:43.941971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:43.961257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:43.967162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:43.968849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:43.970270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 203/387] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:43.982609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:44.000969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:44.001653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:44.001992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:44.002244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:44.003507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:44.005065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:44.009286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 185/388] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:43 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:44.015455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:44.265980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a39b-b9fb-4621-8ab9-c9636a0d53f9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:44.276858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715a5f-5e23-4a60-90c3-c1e6bfd76554 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:44.345657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:44.346293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:44.346581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:44.346847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:44.347756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:44.348067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:44.349657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:44.356636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:44.359195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:44.360576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:44.361206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 204/389] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:44.361582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:44.362277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:44.367359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:44.370298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:44.375486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:44.379598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 186/390] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:44 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:44.388890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:44.492293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3584582-4d58-4ef2-a568-322f86b724ac None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:44.543308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:44.595321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:44.596428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:44.596917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:44.597417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:44.605628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:44.609322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:44.612649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 205/391] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:44 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:44.618590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:44.656233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cdcd8-74e2-46f1-90ec-f113ca024db3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:44.719386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:44.743496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:44.745324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:44.746153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:44.747451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:44.755143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc04c5e3ac948a5937330bd116beba5, group_id=a4948b03b3bd44b39ced10c1dd1d28a2, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:44.756723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:44.769578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465515-7100-4697-a64a-a72bb148d959 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:44.785541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 187/392] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Oct 28 09:32:44 2022] PUT /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:44.821675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b72f-4880-48ce-87c5-c8501a1995ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:44.822385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b72f-4880-48ce-87c5-c8501a1995ed None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:44.822636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b72f-4880-48ce-87c5-c8501a1995ed None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:44.822907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b72f-4880-48ce-87c5-c8501a1995ed None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:44.824229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66b72f-4880-48ce-87c5-c8501a1995ed None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:44.826504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66b72f-4880-48ce-87c5-c8501a1995ed None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:44.828734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 206/393] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:44 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:44.835120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:44.991225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eec28a-212e-4a70-a04d-59528bfb8ac2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:45.005242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:45.050307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952b18-a762-4324-8ec6-a5fab4657865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:45.051014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952b18-a762-4324-8ec6-a5fab4657865 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:45.051298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952b18-a762-4324-8ec6-a5fab4657865 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:45.051578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952b18-a762-4324-8ec6-a5fab4657865 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:45.053978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952b18-a762-4324-8ec6-a5fab4657865 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc04c5e3ac948a5937330bd116beba5, group_id=a4948b03b3bd44b39ced10c1dd1d28a2, role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:45.055599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952b18-a762-4324-8ec6-a5fab4657865 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:45.078102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 188/394] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Oct 28 09:32:44 2022] PUT /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:32:45.758875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fc89-cedf-4afe-bc4d-ce96b6913554 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:45.759622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fc89-cedf-4afe-bc4d-ce96b6913554 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:45.759622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fc89-cedf-4afe-bc4d-ce96b6913554 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:45.761355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 207/395] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:32:45.767833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592b26-fd3c-44f1-9f5a-d691ccfbfc2f None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:45.768629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592b26-fd3c-44f1-9f5a-d691ccfbfc2f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:45.768629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592b26-fd3c-44f1-9f5a-d691ccfbfc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:45.795604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-1f592b26-fd3c-44f1-9f5a-d691ccfbfc2f None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:45.797080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-1f592b26-fd3c-44f1-9f5a-d691ccfbfc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:45.905342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 189/396] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:46.000134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda906-89cd-4eb4-bbb7-37cce7d1bea0 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:46.000879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda906-89cd-4eb4-bbb7-37cce7d1bea0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:46.001362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda906-89cd-4eb4-bbb7-37cce7d1bea0 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:46.002951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 208/397] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:46.015064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:46.015250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:46.015537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:46.049574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:46.050833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:46.158649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 190/398] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:46.456468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda906-89cd-4eb4-bbb7-37cce7d1bea0 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:46.587997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda906-89cd-4eb4-bbb7-37cce7d1bea0 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:46.629716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:46.630728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:46.631218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:46.631695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:46.635634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:46.646655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:46.652444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:46.654344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:46.655535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:46.658048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 209/399] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:46.668077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:46.670531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:46.748988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:46.837571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df616af-e7ed-4d65-a42a-f68c00b30a2a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:46.842323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e44c-300d-4ac2-8327-323cd1959eaa None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:46.883087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:46.883650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:46.883949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:46.884215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:46.885059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:46.885377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:46.886809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:46.900303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 191/400] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:46.901409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:46.902266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:46.902700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:46.903158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:46.908039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:46.928724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:46.942336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:46.943400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:46.944198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 210/401] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:46.953841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:47.023551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:47.027447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:47.038121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918400-c40d-4f7c-a595-4646c64650df None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:47.079109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e64ef6-49b0-495c-a1af-3325532b8113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:47.079779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e64ef6-49b0-495c-a1af-3325532b8113 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.080068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e64ef6-49b0-495c-a1af-3325532b8113 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.080384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e64ef6-49b0-495c-a1af-3325532b8113 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.081891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e64ef6-49b0-495c-a1af-3325532b8113 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:47.083379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e64ef6-49b0-495c-a1af-3325532b8113 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:47.088984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 192/402] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:46 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:47.088984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5967-487d-4ab5-91bc-1d008e987b32 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.088984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5967-487d-4ab5-91bc-1d008e987b32 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.088984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5967-487d-4ab5-91bc-1d008e987b32 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.088984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 193/403] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:47.100802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.101326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.101877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.124577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:47.125945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:47.133442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99345c1-5c31-4079-9157-f95bfd481406 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:47.205134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:47.206000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.206942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.207382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.208188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:47.208640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:47.210511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:47.231262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 211/404] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:47.231262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:47.235145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 194/405] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:47.237807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:47.368284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef889-9115-4224-a99b-ef338df96576 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:47.388188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:47.412184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:47.413047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.413330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.413609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.415024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:47.417281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:47.419736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 212/406] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:47 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:47.427404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:47.540508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:47.578366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04aca0-2221-46f1-a308-7ec324f18ec9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:47.605884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cd315-d12c-43b9-9988-1f7355b7d983 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:47.651223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:47.651836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.652173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.652484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.654793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] RBAC: Authorizing `identity:create_grant(project_id=7106b93a9d784fbb986c39d8499f8652, group_id=a4948b03b3bd44b39ced10c1dd1d28a2, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:47.656280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:47.676584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 213/407] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Oct 28 09:32:47 2022] PUT /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:32:47.681040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:47.682031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:47.682533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:47.682952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] PATH_INFO: `/v3/groups/f0c1abf4a5be4d88a9f26740850fa5b7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:47.685037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] RBAC: Authorizing `identity:get_group(group_id=f0c1abf4a5be4d88a9f26740850fa5b7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:47.686877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:47.689213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 195/408] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:47 2022] GET /identity/v3/groups/f0c1abf4a5be4d88a9f26740850fa5b7 => generated 229 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:47.702034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:47.818927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:47.859089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:47.971696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ab01-a46d-4e90-8862-bfa0eda73630 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:48.049342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:48.050502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.051015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.051496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] PATH_INFO: `/v3/projects/4a3fbfe9961948fb97255019ee76e43a` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.056122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916f7c-f972-4663-8dad-29d308102310 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:48.060633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] RBAC: Authorizing `identity:get_project(project_id=4a3fbfe9961948fb97255019ee76e43a)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:48.063661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:48.073564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 214/409] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:47 2022] GET /identity/v3/projects/4a3fbfe9961948fb97255019ee76e43a => generated 344 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:48.080206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:48.171958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5bb0-6d75-4339-96e2-b67c69af0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:48.173008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5bb0-6d75-4339-96e2-b67c69af0ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.173490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5bb0-6d75-4339-96e2-b67c69af0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.173947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5bb0-6d75-4339-96e2-b67c69af0ce7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.191460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5bb0-6d75-4339-96e2-b67c69af0ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-904b5bb0-6d75-4339-96e2-b67c69af0ce7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:48.197898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:48.198868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:48.199635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 196/410] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:48.202585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb924fc-27a4-4a94-9b07-6b425bd46a68 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.206072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb924fc-27a4-4a94-9b07-6b425bd46a68 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.206072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb924fc-27a4-4a94-9b07-6b425bd46a68 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.208450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 197/411] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:48.210358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb924fc-27a4-4a94-9b07-6b425bd46a68 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:48.243199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:48.295406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906521-e657-4545-941e-8fb9a2a77776 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:48.313245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:48.341100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a32340-ec0f-4b8d-bfba-f535cb872450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:48.341990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a32340-ec0f-4b8d-bfba-f535cb872450 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.342342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a32340-ec0f-4b8d-bfba-f535cb872450 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.342698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a32340-ec0f-4b8d-bfba-f535cb872450 None admin] PATH_INFO: `/v3/projects/4a3fbfe9961948fb97255019ee76e43a/groups/f0c1abf4a5be4d88a9f26740850fa5b7/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.345251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a32340-ec0f-4b8d-bfba-f535cb872450 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a3fbfe9961948fb97255019ee76e43a, group_id=f0c1abf4a5be4d88a9f26740850fa5b7, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:48.346659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a32340-ec0f-4b8d-bfba-f535cb872450 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:48.374445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 215/412] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Oct 28 09:32:48 2022] PUT /identity/v3/projects/4a3fbfe9961948fb97255019ee76e43a/groups/f0c1abf4a5be4d88a9f26740850fa5b7/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:32:48.377153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75175dd-81e2-4375-afd0-d410035e83d6 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.377716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75175dd-81e2-4375-afd0-d410035e83d6 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.378566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75175dd-81e2-4375-afd0-d410035e83d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.424689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb924fc-27a4-4a94-9b07-6b425bd46a68 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:48.440045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c75175dd-81e2-4375-afd0-d410035e83d6 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:48.440045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c75175dd-81e2-4375-afd0-d410035e83d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:48.542239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:48.543976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.544363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.544740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.546695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:48.547440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:48.550556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:48.573093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 198/413] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:48.585799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:48.586431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 216/414] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:48.700908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:48.732437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51faf0-9df9-4395-8f75-dd15af3b67a1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:48.787102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:48.787774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.788047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.788349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.789996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:48.791182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ac77-12b9-4ec6-b788-6e2aa986d689 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.791653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ac77-12b9-4ec6-b788-6e2aa986d689 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.791808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:48.792122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ac77-12b9-4ec6-b788-6e2aa986d689 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.794674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 199/415] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:48 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:48.798484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 217/416] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:32:48.805517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:48.813724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:48.814184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:48.814656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:48.855192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:48.858604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:49.008962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 218/417] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:49.020888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238277f-2ec8-4435-9bf4-016267631db2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:49.081345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:49.082027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:49.082360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:49.082914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:49.083950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:49.085527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:49.087732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 200/418] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:48 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:49.096580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:49.197266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:49.249179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:49.288522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:49.390510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbab03f-042f-4f64-b813-1b85765bc6bd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:49.420271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be635-67d0-4f40-88a3-42ebda99118e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:49.433029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:49.435038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:49.435585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:49.436081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:49.449417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:49.455768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:49.456757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:49.457545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:49.464372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 201/419] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:49.467922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:49.569557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:49.578700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:49.579380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:49.579664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:49.579939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:49.583110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7106b93a9d784fbb986c39d8499f8652, group_id=a4948b03b3bd44b39ced10c1dd1d28a2, role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:49.584759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:49.603193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 219/420] 10.222.0.44 () {58 vars in 1442 bytes} [Fri Oct 28 09:32:49 2022] PUT /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652/groups/a4948b03b3bd44b39ced10c1dd1d28a2/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:32:49.604094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:49.605331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed195f0-429e-43de-ba82-f3ad3f9e6521 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:49.704017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:49.704900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:49.705319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:49.705730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:49.707002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] RBAC: Adding query filter params (name=member) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:49.707458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:49.710028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:49.743328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 202/421] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:49.757547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:49.758908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:49.770119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae28d1-ec83-4163-8010-d7aa867273f8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:49.812045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:49.813133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:49.813655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:49.814135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:49.828036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:49.834190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:49.835148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:49.835925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:49.838703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 220/422] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:49.848687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:49.962252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca1220-0808-4f06-824b-f1592a675913 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:50.010158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:50.010825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:50.011111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:50.011414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:50.024666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:50.101963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:50.103895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:50.143538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d25b-f39e-4b43-a12e-0500ca296b1f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:50.192559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:50.193571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:50.194063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:50.194548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:50.195536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:50.196046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:50.197876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:50.208913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 221/423] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:50.222822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:50.282205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:50.328037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 203/424] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:50.334223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:50.474015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b699bfb-4e2c-409d-ae78-15d23d2b9034 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:50.492666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:50.553309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:50.553938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:50.554215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:50.554709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:50.646338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ff84b-af00-4f37-9eb0-f884dee24eb5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:50.737475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:50.738440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:50.738933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:50.739423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:50.742107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:50.747993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:50.751514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 204/425] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:50 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:50.753006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:50.755855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:50.760799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:50.819475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:51.103096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 222/426] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:51.120181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:51.130206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae868f9c-205d-42ee-8cad-d5d26ae82ba0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:51.157036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:51.199065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51adccc-b7ce-48c8-9d72-a315ca79cd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:51.200620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51adccc-b7ce-48c8-9d72-a315ca79cd3a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.201059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51adccc-b7ce-48c8-9d72-a315ca79cd3a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.201508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51adccc-b7ce-48c8-9d72-a315ca79cd3a None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.203013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51adccc-b7ce-48c8-9d72-a315ca79cd3a None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:51.204734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51adccc-b7ce-48c8-9d72-a315ca79cd3a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:51.206662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 205/427] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:50 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:51.213284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8002ab-1583-444b-9680-93a3e0c33ba4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.213842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8002ab-1583-444b-9680-93a3e0c33ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.214273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8002ab-1583-444b-9680-93a3e0c33ba4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.217310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 206/428] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:51.218497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8002ab-1583-444b-9680-93a3e0c33ba4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:51.275846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3614041-c898-4c7a-95ee-3857818584ef None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:51.296937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:51.321262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b99a8-a190-4e0d-b136-44d8895878f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:51.322282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b99a8-a190-4e0d-b136-44d8895878f9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.322718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b99a8-a190-4e0d-b136-44d8895878f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.323156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b99a8-a190-4e0d-b136-44d8895878f9 None admin] PATH_INFO: `/v3/projects/bdc04c5e3ac948a5937330bd116beba5` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.325271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b99a8-a190-4e0d-b136-44d8895878f9 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc04c5e3ac948a5937330bd116beba5)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:51.326934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b99a8-a190-4e0d-b136-44d8895878f9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:51.328924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 223/429] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:51 2022] GET /identity/v3/projects/bdc04c5e3ac948a5937330bd116beba5 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:51.330512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.330988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.331412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.351247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:51.352940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:51.357979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8002ab-1583-444b-9680-93a3e0c33ba4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:51.398712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:51.399339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.399615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.399889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.400655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=bdc04c5e3ac948a5937330bd116beba5) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:51.400965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:51.402436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:51.410149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 207/430] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:51 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=1d69c101c31d486496fd3165551273f4 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:51.411126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:51.438905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 224/431] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:51.487311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:51.584311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba7c7b-b221-4396-9a0c-1ff437dcd211 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:51.667594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:51.668187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.669240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.669669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.677292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:51.678907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:51.681182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 208/432] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:51 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:51.691092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:51.838646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:51.900006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ab1df-997c-4de2-9f1d-e1139ae54216 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:51.931206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:51.962268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:51.962901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.963179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.963436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.964198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=bdc04c5e3ac948a5937330bd116beba5) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:51.964559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:51.966710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37388c-2fce-4e77-a70d-fdd5345df5c2 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:51.979210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 225/433] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:51 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=bdc04c5e3ac948a5937330bd116beba5&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 611 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:51.983098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b1246-e5a7-43b8-8fac-f1d511b5e232 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.983589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b1246-e5a7-43b8-8fac-f1d511b5e232 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.984063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b1246-e5a7-43b8-8fac-f1d511b5e232 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:51.995032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 226/434] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:51.997588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:51.998231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:51.998746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.008577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23c47-3b72-4cae-b3c7-777b275335c0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:52.024755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:52.026397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:52.027453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:52.098385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:52.099758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:52.100194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:52.100645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.128278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:52.128666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 227/435] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:52.136113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:52.138067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:52.139069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 209/436] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:52.144747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:52.286727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab90d3-e77f-4734-b3c0-0622f177a400 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:52.301121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:52.349760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:52.350398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:52.350683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:52.350959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.351666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] RBAC: Adding query filter params (name=member) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:52.352048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:52.353578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:52.365398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 228/437] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:52.373778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:52.472677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:52.508735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90eb8-66f5-4eed-96a7-293f92c9535f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:52.558239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:52.558800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:52.559608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:52.559897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.608011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:52.629443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ee5dc-2de2-452b-ae5e-7dd7aa48e4df None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:52.657363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:52.659164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:52.681662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:52.682661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:52.683128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:52.683636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.698720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:52.705402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:52.706451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:32:52.707257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:32:52.711511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 229/438] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:52.713529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:52.756459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:52.802756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 210/439] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:32:52.803949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:52.846102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a724e-2d1a-4ff0-b472-cb111952890a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:52.880518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:52.892558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:52.893179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:52.893456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:52.893727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.894965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:52.895353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:52.897202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:52.907692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 230/440] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:52.913807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:52.925018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16567cd7-e379-4ced-99a6-e9fc62b613df None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:52.967236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:52.968056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:52.968213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:52.968525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:52.969776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:52.971302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:52.973065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 211/441] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:52.978931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:53.030414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:53.040597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffba76c-0ec4-4ca1-9a24-1792a8aaaa47 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:53.085184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89fa5c-1f7b-4358-a1b9-466b6aac92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:53.086283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89fa5c-1f7b-4358-a1b9-466b6aac92e3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.086794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89fa5c-1f7b-4358-a1b9-466b6aac92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.087305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89fa5c-1f7b-4358-a1b9-466b6aac92e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.107411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0c8b-c10f-40ac-adca-caaa23e68897 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:53.148846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:53.149789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.150068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.150339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.152204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:53.154775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:53.156731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 212/442] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:53.162782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:53.166309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:53.186325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89fa5c-1f7b-4358-a1b9-466b6aac92e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:53.188525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89fa5c-1f7b-4358-a1b9-466b6aac92e3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:53.301337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65d070-b824-44c2-b47a-84fa1d8a8a19 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:53.325538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:53.345102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 231/443] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:53.346749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5e331-d248-4a8e-84a6-6fc4f44fc5fc None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.347139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5e331-d248-4a8e-84a6-6fc4f44fc5fc None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.347499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5e331-d248-4a8e-84a6-6fc4f44fc5fc None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.349321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 232/444] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:53.351136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5e331-d248-4a8e-84a6-6fc4f44fc5fc None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:53.355247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:53.356220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.356720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.357181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.358354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=1d69c101c31d486496fd3165551273f4, scope.project.id=7106b93a9d784fbb986c39d8499f8652) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:53.358594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:53.360914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0d55a-ecfb-45a4-9b7b-a7581c03935e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:53.369739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 213/445] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:53 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=1d69c101c31d486496fd3165551273f4 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:53.371112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.371407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.371731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.403847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:53.405626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:53.521717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:53.529841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5e331-d248-4a8e-84a6-6fc4f44fc5fc None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:53.540490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 214/446] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:53.601010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:53.601686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.602073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.602330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] PATH_INFO: `/v3/projects/4a3fbfe9961948fb97255019ee76e43a` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.603617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] RBAC: Authorizing `identity:get_project(project_id=4a3fbfe9961948fb97255019ee76e43a)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:53.605159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:53.607472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 233/447] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:53 2022] GET /identity/v3/projects/4a3fbfe9961948fb97255019ee76e43a => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:53.616826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:53.786900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232094f-2ea9-4a7a-b9f6-18bff723a9cb None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:53.852495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:53.853582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:53.854074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:53.854576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] PATH_INFO: `/v3/groups/f0c1abf4a5be4d88a9f26740850fa5b7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:53.858188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] RBAC: Authorizing `identity:get_group(group_id=f0c1abf4a5be4d88a9f26740850fa5b7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:53.860951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:53.864045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 215/448] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:53 2022] GET /identity/v3/groups/f0c1abf4a5be4d88a9f26740850fa5b7 => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:53.874581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:53.921532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:53.968892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:54.019717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3df0-5029-4513-bb02-94e4f0508744 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:54.027280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:54.062728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:54.063350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:54.063627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:54.063894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:54.064688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] RBAC: Adding query filter params (group.id=f0c1abf4a5be4d88a9f26740850fa5b7, role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=4a3fbfe9961948fb97255019ee76e43a) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:54.064998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:54.066462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:54.073116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 234/449] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:53 2022] GET /identity/v3/role_assignments?group.id=f0c1abf4a5be4d88a9f26740850fa5b7&scope.project.id=4a3fbfe9961948fb97255019ee76e43a&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:54.087658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f6bf9-e02c-4db9-8010-ab6f313b8e11 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:54.128633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:54.129366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:54.129758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:54.130124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:54.144208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:32:54.149362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:54.151606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:54.154045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 216/450] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:32:54.157795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:54.279744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ba8f-91df-4245-81e2-bde1b6c71f09 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:54.307594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:54.320043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:54.320702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:54.320981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:54.321251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:54.321941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:54.322249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:54.323657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:54.333846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 235/451] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:32:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:32:54.339919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:54.507031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95332c8-f407-4c1c-9438-cc1c2a78a71c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:54.552173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:54.572204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:54.573258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:54.573720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:54.574205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:54.701376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:54.704142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:54.820430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 217/452] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:32:54.827165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:54.942771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6280-9a72-4674-9fe6-00d4ebecdb6a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:54.981567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:54.982217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:54.982500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:54.982778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] PATH_INFO: `/v3/projects/7106b93a9d784fbb986c39d8499f8652` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:54.984003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] RBAC: Authorizing `identity:get_project(project_id=7106b93a9d784fbb986c39d8499f8652)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:54.985547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:54.987323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 236/453] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:32:54 2022] GET /identity/v3/projects/7106b93a9d784fbb986c39d8499f8652 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:54.993465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:55.022617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:55.113238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc1f3-9b3a-465f-ad2b-0ab2cc9b4bcf None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:55.154184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457e7ae-77f7-4c00-b2c0-312c677254d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:55.155206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e7ae-77f7-4c00-b2c0-312c677254d4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:55.155206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e7ae-77f7-4c00-b2c0-312c677254d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:55.155536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457e7ae-77f7-4c00-b2c0-312c677254d4 None admin] PATH_INFO: `/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:55.156977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457e7ae-77f7-4c00-b2c0-312c677254d4 None admin] RBAC: Authorizing `identity:get_group(group_id=a4948b03b3bd44b39ced10c1dd1d28a2)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:55.158761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457e7ae-77f7-4c00-b2c0-312c677254d4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:55.160555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 218/454] 10.222.0.44 () {56 vars in 1180 bytes} [Fri Oct 28 09:32:54 2022] GET /identity/v3/groups/a4948b03b3bd44b39ced10c1dd1d28a2 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:55.167311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:55.232226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:55.284449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbde891-211f-48a4-af00-3b9775f9c402 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:55.325365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:55.326058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:55.326382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:55.326714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:55.327523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] RBAC: Adding query filter params (group.id=a4948b03b3bd44b39ced10c1dd1d28a2, role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=7106b93a9d784fbb986c39d8499f8652) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:32:55.327877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:55.329459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b98f1-a4a3-4b40-a8a5-f38fbebfdf44 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:55.336674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 237/455] 10.222.0.44 () {56 vars in 1376 bytes} [Fri Oct 28 09:32:55 2022] GET /identity/v3/role_assignments?group.id=a4948b03b3bd44b39ced10c1dd1d28a2&scope.project.id=7106b93a9d784fbb986c39d8499f8652&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:32:58.789471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd428-de3b-4958-92e0-a7765bacd2f5 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:58.796127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd428-de3b-4958-92e0-a7765bacd2f5 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:58.796127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd428-de3b-4958-92e0-a7765bacd2f5 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:58.797011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 219/456] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:58.806266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55a00e-7d7d-498a-b034-99b380348962 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:58.807658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55a00e-7d7d-498a-b034-99b380348962 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:58.808484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55a00e-7d7d-498a-b034-99b380348962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:58.862042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-6c55a00e-7d7d-498a-b034-99b380348962 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:58.864601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-6c55a00e-7d7d-498a-b034-99b380348962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:59.033558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 238/457] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:59.445494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd428-de3b-4958-92e0-a7765bacd2f5 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:59.564853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:59.583702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd428-de3b-4958-92e0-a7765bacd2f5 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:59.640734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:32:59.641719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:59.642212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:59.642707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:59.672443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:32:59.675295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:32:59.681287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0150b0-a174-4a65-9611-db2c6c4c9249 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:59.682124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0150b0-a174-4a65-9611-db2c6c4c9249 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:59.682622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0150b0-a174-4a65-9611-db2c6c4c9249 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:59.685540 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 239/458] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:59.693904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388ca3-b998-4695-a6c7-f42e291a3490 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:59.694535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388ca3-b998-4695-a6c7-f42e291a3490 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:59.695022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388ca3-b998-4695-a6c7-f42e291a3490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:32:59.719268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:32:59.720278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:32:59.721130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:32:59.721130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:32:59.721130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:32:59.733460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 220/459] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:32:59.740693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:32:59.766157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-1c388ca3-b998-4695-a6c7-f42e291a3490 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:32:59.768214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-1c388ca3-b998-4695-a6c7-f42e291a3490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:32:59.900984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:32:59.943298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 240/460] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:32:59.945039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca5fe-6647-4378-b74a-32610074fb30 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:59.945603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca5fe-6647-4378-b74a-32610074fb30 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:59.946081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca5fe-6647-4378-b74a-32610074fb30 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:59.952739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 241/461] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:32:59.957938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:32:59.958875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:32:59.959561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:32:59.987473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eac4b-bdf4-4cce-bd5d-a1797675d0d8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:32:59.999229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:00.001945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:00.082036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:00.082036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.082036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.082579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.082950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:00.083217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:00.084665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:00.114936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 221/462] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:00.125962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:00.136156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:00.153805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 242/463] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:00.293254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7483-9bb0-4e87-b341-b016eaa966bf None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:00.341839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:00.345218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:00.346983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.346983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.346983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.347402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:00.348655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:00.386965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 222/464] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:00 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:33:00.511671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1235-f308-48e3-882a-4d67cbdca701 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:00.525183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:00.560183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:00.561113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.561392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.561663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.582728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:00.584279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:00.614916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:00.616713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:00.618354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:00.618354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:00.618354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:00.618354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 243/465] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:00.623850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:00.702085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:00.711512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:00.756718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba572-8ed3-4a52-b053-f15792e2ad90 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:00.806795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:00.807726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.808226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.809460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.811029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:00.811578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:00.814648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d277374-309a-44c7-a101-1327d850c9e6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:00.840144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 223/466] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:00.843094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9cfce-230f-4b8f-8eae-4099cf6d344a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.843576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9cfce-230f-4b8f-8eae-4099cf6d344a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.843743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932c793-1231-47e8-8cb3-af84ba3aa364 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:00.848288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9cfce-230f-4b8f-8eae-4099cf6d344a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.848288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 224/467] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:00.858657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9cfce-230f-4b8f-8eae-4099cf6d344a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:00.903351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:00.904332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.904808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.905260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.926653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:00.928180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-848eed58-4966-4059-aafd-75b9c3c0c270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:00.954304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:00.955734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:00.957434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:00.957434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:00.957434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:00.957434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 244/468] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:00.958676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:00.958939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:00.959180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:00.985612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:00.986838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:00.997665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:01.064604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9cfce-230f-4b8f-8eae-4099cf6d344a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:01.082924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 245/469] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:01.083884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:01.101476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:01.122637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be3c9-f5a8-4bd2-9b96-8cb17d923663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:01.123787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be3c9-f5a8-4bd2-9b96-8cb17d923663 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.124479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be3c9-f5a8-4bd2-9b96-8cb17d923663 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.125476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be3c9-f5a8-4bd2-9b96-8cb17d923663 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.126704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be3c9-f5a8-4bd2-9b96-8cb17d923663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:01.128664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be3c9-f5a8-4bd2-9b96-8cb17d923663 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:01.159889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 225/470] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:00 2022] POST /identity/v3/users => generated 246 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:33:01.162815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e47a-6bfd-426d-a37f-d5244d4e6ea1 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.163215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e47a-6bfd-426d-a37f-d5244d4e6ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.163488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e47a-6bfd-426d-a37f-d5244d4e6ea1 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.169688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 226/471] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:01.171682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.171966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.172311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.194196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:01.195513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:01.231296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e0882-08de-42cf-a573-8ed6c3724544 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:01.283466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:01.284612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.285107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.286212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.287237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:01.287754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:01.289766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:01.303930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 227/472] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:01.306750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 246/473] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:01.315464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:01.503304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec357d4f-beb1-4b28-9670-2e67fa8ad0d2 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:01.513079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:01.522889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:01.528188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:01.556881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:01.557225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.557597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.557874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.559284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:01.561256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:01.589084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 228/474] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:01 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:01.664862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17809b42-b27d-4dcc-bda6-151ca177e3b2 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:01.715067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:01.716174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.716774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.717251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.730303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:01.732907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:01.750504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:01.751489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:01.752356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:01.752356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:01.752356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:01.754661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 247/475] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:01.761208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:01.821761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:01.911940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb3d57-b902-47d7-9847-c1f83cbf5a3a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:01.916946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:01.961970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:01.962665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:01.962949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:01.963280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:01.963950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:01.964286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:01.966166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:01.984698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 229/476] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:01.988522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65fceb-0884-4be6-8637-174a561c38b2 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:01.992518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:02.026517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:02.044045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:02.047123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:02.047619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:02.048038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:02.049024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:02.050625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:02.063697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.sql.core [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:33:02.063697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 09:33:02.063697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [parameters: {'id': '076d5f015fb044f9bdab6b731d10fd44', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 09:33:02.063697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88073) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application result.read() Oct 28 09:33:02.085724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return ref.to_dict() Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:33:02.086691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application yield resource Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise self.value Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application session.commit() Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:33:02.087628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:33:02.088593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:33:02.089623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application result.read() Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:33:02.098312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [parameters: {'id': '076d5f015fb044f9bdab6b731d10fd44', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:02.099100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 09:33:02.100481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:02.104754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 248/477] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Oct 28 09:33:01 2022] POST /identity/v3/roles => generated 144 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:02.104754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:02.156293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0801dc-10c6-43df-b650-507df3a91d24 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:02.200554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:02.201106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:02.201508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:02.201795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:02.202479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:02.203967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:02.235585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 230/478] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:01 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:02.269086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e091f6-38be-43d3-a513-2bfe73242c1f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:02.306066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:02.338157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d768d-1b7c-47ed-b18a-4868fe5e8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:02.338821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d768d-1b7c-47ed-b18a-4868fe5e8b0e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:02.339099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d768d-1b7c-47ed-b18a-4868fe5e8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:02.339376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d768d-1b7c-47ed-b18a-4868fe5e8b0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:02.363883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d768d-1b7c-47ed-b18a-4868fe5e8b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-413d768d-1b7c-47ed-b18a-4868fe5e8b0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:02.369552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:02.370505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:02.371317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 249/479] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:02.377289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:02.559204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:02.616492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b11b8d-7639-416e-b6d6-1950ad280ed9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:02.674239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:02.674881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:02.675166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:02.675444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:02.676136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:02.676481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:02.677924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ed63-94fe-4e9b-92f6-c8a038d822dc None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:02.688104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 231/480] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:04.554049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089a8f-1c9f-4e3e-aafb-d163503bf5a6 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:04.555142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089a8f-1c9f-4e3e-aafb-d163503bf5a6 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:04.555671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82089a8f-1c9f-4e3e-aafb-d163503bf5a6 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:04.557382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 250/481] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:04.564457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:04.564979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:04.565214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:04.597077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:04.598352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:04.670094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd264e-eb8f-455c-8aa6-e2a2538cb925 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:04.671078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd264e-eb8f-455c-8aa6-e2a2538cb925 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:04.671498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd264e-eb8f-455c-8aa6-e2a2538cb925 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:04.680445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 251/482] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:04.688214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6ac5-690f-4ec6-8e8e-7112b7f1dcc1 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:04.688760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6ac5-690f-4ec6-8e8e-7112b7f1dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:04.689320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6ac5-690f-4ec6-8e8e-7112b7f1dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:04.759430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-3d8b6ac5-690f-4ec6-8e8e-7112b7f1dcc1 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:04.761544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3d8b6ac5-690f-4ec6-8e8e-7112b7f1dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:04.803151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 232/483] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:04.957063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 252/484] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:05.253172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:05.397200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:05.407222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72cf0-16ee-4733-8561-a92947f3ab3a None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:05.407670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72cf0-16ee-4733-8561-a92947f3ab3a None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:05.408139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72cf0-16ee-4733-8561-a92947f3ab3a None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:05.410809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 253/485] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:05.417498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:05.418563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:05.424641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:05.476360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0cde-2dad-40a4-9c61-8647fb6dd503 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:05.499038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:05.501481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:05.537902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:05.538809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:05.539281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:05.539740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:05.560148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:05.568963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:05.571348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:05.572950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 233/486] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:05.577917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:05.647169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 254/487] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:05.648357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:05.707282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:05.806735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448171-bc8b-4e77-9d15-43b6e7f054cd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:05.849730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:05.866843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:05.867207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdf5cf-a9fe-4c7a-bbce-52e06cdb27a9 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:05.868058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:05.868553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:05.869018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:05.891512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:05.902922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:05.904298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:05.905095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:05.907497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 234/488] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:05.919681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:05.958924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:05.959943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:05.968608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:05.969214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:05.970507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:05.971031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:05.973603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.005886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 255/489] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:06.013052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.048318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621ce8-f5c0-4e06-9f2e-c9fa881b7eb2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.088455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.089491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.089970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.091011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.092356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:06.092887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.094626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.104456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 235/490] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:06.105927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.143777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:06.148772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fcc42-fac5-40b3-a6b1-28a5655d5421 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.173689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:06.193401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.194336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.194865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.195324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.209897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.211905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:06.229839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:06.231449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:06.232898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:06.232898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:06.232898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:06.234451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a784631-9f85-46be-9ab6-752a99038bb6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.239913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 256/491] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:06.241887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.275502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.276360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.276713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.277056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.297187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:06.302857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:06.303804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:06.304637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:06.309051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 236/492] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:06.310498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.375673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e41d6b-b39b-40ab-85b3-408a960232f6 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.420208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.421328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.421852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.422433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.434138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297006e-e89b-497b-900e-5cadf54ff17b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.438852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.440989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.452716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:06.463065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:06.464024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:06.466269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:06.466269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:06.466269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:06.468678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 257/493] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:06.469969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.474472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:06.483594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.484801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.485006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.485328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.486031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:06.486358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.487789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.504435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 237/494] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:06.505894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.607300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ac039-8806-47e7-8323-997287254294 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.633691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838d7ca-f65c-4ba6-87fc-5d0304e8cfcb None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.650274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.650892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.651169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.651440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.652122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:06.652476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.654439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.668537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 258/495] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:06.668537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.679510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.680144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.680454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.680730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.681403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:06.681707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.683132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe607f6-eff2-4091-b967-24386097e78b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.699514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 238/496] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:06.701625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb652d-f72a-4b07-8139-1caa85366ffb None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.702086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb652d-f72a-4b07-8139-1caa85366ffb None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.702529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb652d-f72a-4b07-8139-1caa85366ffb None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.705261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 239/497] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:06.706052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb652d-f72a-4b07-8139-1caa85366ffb None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.745432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:06.752165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:06.794944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5dabf-43cd-4faf-8945-ddd8df80fa52 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.830253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb652d-f72a-4b07-8139-1caa85366ffb None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:06.833999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.834644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.834919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.835186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.844661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.846151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-1dd5197e-9f5e-463b-a675-6bb46df0a78c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:06.861075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:06.869590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 259/498] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f97a-408f-48dd-a25a-20cb65151519 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.870494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f97a-408f-48dd-a25a-20cb65151519 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.871318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f97a-408f-48dd-a25a-20cb65151519 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.871318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 260/499] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:06.871318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f97a-408f-48dd-a25a-20cb65151519 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:06.880021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:06.880964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.881243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.881517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.893945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:06.895356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-310cc67c-deea-4c40-bfea-a24782ef7f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:06.911413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:06.913339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:06.915228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:06.915228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:06.915228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:06.920285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 240/500] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:06.920285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:06.920285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:06.920285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:06.939741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:06.941484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:06.986802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f97a-408f-48dd-a25a-20cb65151519 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:07.018914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 241/501] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:07.019800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:07.035036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:07.041561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:07.051660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:07.053095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.053722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.054214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.073727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:07.077917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-fa025217-2992-4e67-b326-c842fb5803cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:07.099543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:07.101351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:33:07.103049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:07.108725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 261/502] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:07.111759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.112282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.112734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.145551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:07.147657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:07.175119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8976223-fdb7-4bd3-8c35-00c79575c0f9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:07.240950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:07.242013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.242497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.242976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.244390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:07.244936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:07.248888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:07.264285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 262/503] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:07.264285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:07.304617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 242/504] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Oct 28 09:33:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:07.305522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:07.424570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:07.469565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b020f-052e-4521-8095-9f798cc1b2d5 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:07.478066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635ee35-2014-44e9-9bf2-3c94e085cd02 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:07.499964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:07.532360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:07.533244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.533685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.534101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.535196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:07.535689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:07.537905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:07.546217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:07.547196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.547649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.548102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.549415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:07.549905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:07.552122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:07.566471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 263/505] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:07.566471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:07.583188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 243/506] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Oct 28 09:33:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:07.584665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:07.747058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612074-21fe-4f70-bac6-7659a6ad29b1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:07.761352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461272-8c8b-4265-87ec-0d53470dc031 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:07.805764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:07.806597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.807039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.807476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.817644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:07.827866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:07.828723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:07.829122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:07.829516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:07.842456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:07.844548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:07.866923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:07.868855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:07.870432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:07.870432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:07.870432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:07.870432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 244/507] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:07.870432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:07.883470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:07.921258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:07.922752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.009076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a71158-2f7a-401d-92ee-a63a5d398fce None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.049773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.050560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.050922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.051279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.061550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.063054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.076962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 264/508] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:08.077562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:08.079248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:08.081600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:08.082776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.082923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 245/509] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:33:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:08.082923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.157016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:08.205563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:08.227891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a59df-f5cd-4cd0-a46c-7548ddb55082 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.233433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d932-85db-47bc-8d70-338c0dd3b537 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.270626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.271177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.271511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.271786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.284729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.285137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:08.285789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.286286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.286712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:08.291944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:08.294316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 246/510] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:08.295876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.379908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.381803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.429823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34943da6-45df-4df9-af9c-42fc6ae005c1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.432071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:08.472201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.472871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.473149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.473421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.474102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:08.474407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.475912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.491471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 247/511] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:08.492397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.510897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:08.546020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 265/512] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:08.546865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.664626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d530276-12bf-483c-850b-0ee6c8e1a0e0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.675276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8241b-fb6f-4227-8eda-491121397b0f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.715423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.715801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.715801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.727436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.727795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.728587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.729096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.729347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.729604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.731120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:08.731667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.734552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:08.747602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:08.748905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:08.749965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:08.749965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:08.749965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:08.749965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 248/513] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:08.749965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.779224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:08.789533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 266/514] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:08.790390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.833876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:08.898021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3beb6-6074-479c-8851-bc20b54344d3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.916226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575fdf-cefa-42ce-8add-e55b03229345 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:08.943313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.943937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.944215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.944512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.945194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:08.945494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.946940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:08.960276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 249/515] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:08.960276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:08.965821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:08.966887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:08.967383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:08.967877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:08.969112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:08.971917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:09.002807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 267/516] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:08 2022] POST /identity/v3/users => generated 247 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:09.003730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:09.076193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:09.118926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad9084-28bb-47ac-af64-f7a8eb536b7c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:09.159386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:09.179239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044b75-099d-4771-9ff8-0c916fdb61a7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:09.181838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:09.183004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:09.183464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:09.184021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:09.204506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:09.207043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:09.232729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:09.234722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:09.236407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:09.236407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:09.236407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:09.236407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 250/517] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:09.236858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:09.247576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:09.248453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:09.248858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:09.249253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:09.250106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:09.250588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:09.252221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:09.271749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 268/518] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:09.272832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:09.423428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43833-5adb-46e3-a408-f6a36b3c175d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:09.462957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d552b-1290-4172-814c-3c06cc5a65f5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:09.479226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:09.497190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:09.498423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:09.498974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:09.499490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:09.509541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:09.510195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:09.510466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:09.510740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:09.524153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:09.525704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:09.545089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:09.546956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:09.548703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:09.548703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:09.548703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:09.548703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 269/519] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:09.548703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:09.555389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:09.632632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:09.636063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:09.720394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba8e32-717a-475d-afac-23e816bfb0c1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:09.761265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:09.761902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:09.762703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:09.763197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:09.763889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:09.764193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:09.765655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:09.779769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 270/520] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:09.780492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:09.827915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 251/521] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:09.828853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:09.864292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:09.899946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:09.975576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a717-616e-489f-b879-9dcebfe528db None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:09.990812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5f372-6269-47b6-96ed-93e128789e17 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.023291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.024483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.024939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.025377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.035646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.037752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.060173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.061259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:10.061448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:10.062260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:10.063094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:10.063508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.063508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.063508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:10.069123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.069204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 271/522] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:10.069204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.069330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.101480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 252/523] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:10.101480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.253628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24657ca2-ccaf-4dca-adb6-20d8e2eb55e5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.261791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:10.283814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084df86-e955-466b-b102-bfff8fa69139 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.293706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:10.309396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.310261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.310749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.311028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.319076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.320581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.330775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.331689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.332156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.332604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:10.333439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:10.334296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 272/524] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:10.335685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.354136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.356898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:10.384675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:10.385788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:10.386631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:10.386631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:10.386631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:10.386631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 253/525] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:10.388933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.508373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb21d33-306f-4851-a8e7-0a9ede8bb8ad None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.548262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251c7ae-a74e-4db7-83d8-110b08bdcadd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.568538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.569620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.570125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.570623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.571876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:10.572466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.575950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.592085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.593008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.593464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.593972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.604559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.606692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.609996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 273/526] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:10.610904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:10.611612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:10.627250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:10.629128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:33:10.631164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:10.633070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 254/527] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:10.634542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.693837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:10.773873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9bf80-6017-400c-91c9-0055311ed54b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.811467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ff38-1def-42f9-8794-1d3a1756ae8f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:10.839982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.842856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.843291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.844047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.845090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:10.845619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.848406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.858416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:10.859209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:10.859388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:10.859727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:10.860302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:10.860825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:10.862117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:10.887677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 274/528] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:10.887937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 255/529] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:10.887937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:10.888149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:11.041327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:11.057791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41d56-9a1a-4ba1-9fb2-8083ea4758d4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:11.061488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:11.100116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:11.100768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:11.101073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:11.101421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:11.102182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=a6b9ce9facf54e809bd8e569b27a6791) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:11.102487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:11.103954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:11.116339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 275/530] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/role_assignments?user.id=a6b9ce9facf54e809bd8e569b27a6791&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:11.116339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:11.133561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7d37-6edf-4b49-8fec-445b5a080664 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:11.211506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:11.212722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:11.213210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:11.213692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:11.215185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:11.215743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:11.219779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:11.258145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 256/531] 10.222.0.44 () {56 vars in 1139 bytes} [Fri Oct 28 09:33:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:11.260633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:11.437358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354836d9-72b1-44e4-92e5-d9adcb33228d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:11.495983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f156f-2ebd-4c2f-90f0-5e5c4d2fadbf None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:11.547994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:11.551527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:11.552448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:11.556007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:11.566718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:11.580908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:11.583823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:11.604967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:11.606730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:11.608484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:11.609316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:11.609316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:11.609316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:11.609316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:11.610677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=3233db58d77647ba9687c8d51a427eb6) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:11.610958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:11.613432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:11.614074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 276/532] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:11.615760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:11.640855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 257/533] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:11 2022] GET /identity/v3/role_assignments?user.id=3233db58d77647ba9687c8d51a427eb6&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:11.642299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:11.696857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:11.926534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f435-1365-4757-a609-98c8f33a7d97 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:11.948179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266a716-6c3b-4dda-94cd-3491a95a4599 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:12.001170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2222b-ea5a-4c68-a523-edbb1ea4b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:12.002171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2222b-ea5a-4c68-a523-edbb1ea4b16a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:12.002691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2222b-ea5a-4c68-a523-edbb1ea4b16a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:12.003147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2222b-ea5a-4c68-a523-edbb1ea4b16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:12.047285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:12.048512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:12.049145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:12.049565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:12.050934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:12.051462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:12.054317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:12.096659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 258/534] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:12.113803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:12.189797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2222b-ea5a-4c68-a523-edbb1ea4b16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:12.191267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2222b-ea5a-4c68-a523-edbb1ea4b16a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:12.232851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:12.257902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:12.350942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069971c-018a-44b6-9e83-91657d6f2280 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:12.405414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 277/535] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:12.407480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd9a1-7355-4519-ae81-a6c53bcbd39d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:12.408076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd9a1-7355-4519-ae81-a6c53bcbd39d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:12.408616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acd9a1-7355-4519-ae81-a6c53bcbd39d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:12.415150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 278/536] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:12.417247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd9a1-7355-4519-ae81-a6c53bcbd39d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:12.423999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:12.424853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:12.425324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:12.425818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:12.427217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=7b34a8c7d4f242c3a5be691db48cc0d5) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:12.427763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:12.431424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62185fa-ebfb-47bb-9c52-e84c41591ef7 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:12.444365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 259/537] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:12 2022] GET /identity/v3/role_assignments?user.id=7b34a8c7d4f242c3a5be691db48cc0d5&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:12.446979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:12.447486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:12.448203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:12.483498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:12.485563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:12.561429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acd9a1-7355-4519-ae81-a6c53bcbd39d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:12.614943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:12.632436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:12.634165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:12.634906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:12.635669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:12.636477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 260/538] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:12.675674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:12.679225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:12.722318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:12.724371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:12.726347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:12.726347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:12.726347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:12.735191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 279/539] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:12.741867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:12.854658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:13.028652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d4697-75cb-4eef-8a47-92d353b866b2 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:13.128562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:13.129604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:13.130103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:13.130585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:13.131764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:13.132318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:13.135024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:13.164981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 261/540] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:13.171871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:13.362887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a29d-2f7a-450c-b06c-9eb7b59faded None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:13.425933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:13.425933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:13.425933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:13.425933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:13.431313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:13.438601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:13.440553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:13.461630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:13.462554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:13.463428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 280/541] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:13.470130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:13.563836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:13.685948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:13.699215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02462-b511-4480-b26a-c8f786c3754b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:13.707395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80869b-5faa-4f28-98dd-ce0aa58f1036 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:13.756099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:13.756754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:13.757028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:13.757294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:13.758010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:13.758312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:13.759790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:13.792101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 281/542] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:13.800274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:13.800274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:13.800274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:13.800274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:13.807083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:13.813742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:13.819655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:13.821165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:13.822610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 262/543] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:13.829324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:13.967350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473908ea-3349-4673-b82f-e205bd57fc95 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:14.016276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:14.016276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.016276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.016276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.016695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:14.016695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:14.016695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:14.044438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 263/544] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:14.054271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:14.098364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:14.106221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:14.118052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3256-20be-4373-bd07-1aa449ae1929 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:14.195409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:14.196027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.196351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.196622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.197367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=828e306d81f64846b2b8f07b3dd1e5a4) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:14.197670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:14.201266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:14.208432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 282/545] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:13 2022] GET /identity/v3/role_assignments?user.id=828e306d81f64846b2b8f07b3dd1e5a4&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:14.297344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc55c35-b3cc-46ad-b847-835750940862 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:14.352566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:14.353675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.354155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.354612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.377087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:14.378960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-d8840884-bfe3-417a-a732-5beafd5a54e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:14.399499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:14.400495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:14.401964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:14.401964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:14.401964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:14.403916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 264/546] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:14.412031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:14.572511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39dadf-4780-4517-8f02-5ac3faf47084 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.573223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39dadf-4780-4517-8f02-5ac3faf47084 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.573715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39dadf-4780-4517-8f02-5ac3faf47084 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.575937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 265/547] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:14.581990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.582349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.582596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.611522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:14.612885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:14.691753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ee78-2ff9-4fbc-8fcb-baa4573d8001 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:14.738131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:14.738832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.739108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.739376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.740791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:14.741105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:14.748270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:14.759570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 283/548] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:14.768642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:14.769106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:14.783214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 266/549] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:14.801791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:14.892774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdcd54-7fd8-4b7c-bbe1-a4fef085d647 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:14.935664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:14.936345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:14.936623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:14.936895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:14.948806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:14.950839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:14.964452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:14.965506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:14.966511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 284/550] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:14.974294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:15.177986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc12070-999b-46b6-8268-f28ce97f86eb None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:15.235977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:15.236940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:15.237374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:15.237797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:15.238708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:15.239198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:15.240974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:15.270966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 267/551] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Oct 28 09:33:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:15.279717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:15.373366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:15.403164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:15.437103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058d80b-7501-458e-af71-03310c49e8d3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:15.485363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504d11-5661-4fd6-87ec-3c21211ff7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:15.486661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504d11-5661-4fd6-87ec-3c21211ff7c9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:15.486947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504d11-5661-4fd6-87ec-3c21211ff7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:15.487223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504d11-5661-4fd6-87ec-3c21211ff7c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:15.575886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504d11-5661-4fd6-87ec-3c21211ff7c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:15.577607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504d11-5661-4fd6-87ec-3c21211ff7c9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:15.587874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:15.678807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec0b6-d1e8-4859-9e2f-1d4618bdaa7c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:15.726271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9cc65-bb1a-4ce6-b284-c7d1530578a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:15.727641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cc65-bb1a-4ce6-b284-c7d1530578a0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:15.727924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cc65-bb1a-4ce6-b284-c7d1530578a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:15.728199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cc65-bb1a-4ce6-b284-c7d1530578a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:15.742411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:15.745612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9cc65-bb1a-4ce6-b284-c7d1530578a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-94c9cc65-bb1a-4ce6-b284-c7d1530578a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:15.753622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:15.754855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:15.756066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:15.758567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 268/552] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:15.760095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65922a-4eae-4878-b72d-893367b6b483 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:15.760559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65922a-4eae-4878-b72d-893367b6b483 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:15.761000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65922a-4eae-4878-b72d-893367b6b483 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:15.763232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 269/553] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:15.773117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65922a-4eae-4878-b72d-893367b6b483 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:15.799375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 285/554] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:15.802063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857b00-9783-46cc-a650-99c95c279304 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:15.802567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857b00-9783-46cc-a650-99c95c279304 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:15.803056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857b00-9783-46cc-a650-99c95c279304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:15.837279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-be857b00-9783-46cc-a650-99c95c279304 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:15.839377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-be857b00-9783-46cc-a650-99c95c279304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:15.937794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65922a-4eae-4878-b72d-893367b6b483 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:15.960348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 286/555] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:15.960348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857b00-9783-46cc-a650-99c95c279304 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:15.971265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:16.014031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.014920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.015702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.016173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.018016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:16.018856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:16.021356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62181da6-e7b8-46a5-9e2d-f7c5e9fffa88 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:16.046429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 270/556] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:16.049961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e560ca-f4ee-4674-a255-c41e24596832 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.050430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e560ca-f4ee-4674-a255-c41e24596832 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.051852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e560ca-f4ee-4674-a255-c41e24596832 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.054607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 271/557] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:16.056823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e560ca-f4ee-4674-a255-c41e24596832 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.142710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857b00-9783-46cc-a650-99c95c279304 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:16.171373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:16.213128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.214409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.214718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.215165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.230685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:16.241436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-6eb8683e-ebc0-4a04-be19-2e26aa2765ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:16.261064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:16.263448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 287/558] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.265653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.269363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e560ca-f4ee-4674-a255-c41e24596832 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:16.286571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:16.287846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:16.325947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.327388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.329069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.329535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.352104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:16.354989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:16.377665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:16.378897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:16.379970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:16.379970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:16.379970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:16.383964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 272/559] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:16.385145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.404440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 288/560] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:16.406648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.433074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:16.533781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:16.544879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2cb7-db59-492f-a915-703ba6de531b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:16.545764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667790b-a6fc-4fbb-82b3-390750b21671 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:16.597497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.597940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.598204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.598489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.598766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.599548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.600078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.600633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.601576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:16.602202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:16.604042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:16.613429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:16.622427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:16.623442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 273/561] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:16.624859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.626186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 289/562] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:16.627435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.743485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:16.758324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bae4c-e69e-43dd-b044-8d061e3feb30 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:16.773211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb045-fdc8-4a69-9e67-3b6c8d0f5d5f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:16.808150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.808710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.809054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.809324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.809982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:16.810282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:16.811720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:16.834751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 274/563] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:16.834751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.836989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:16.838259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:16.838880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:16.839490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:16.853061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:16.856502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:16.878667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:16.880377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:16.882550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 290/564] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:16.883492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:16.914857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:16.991599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e3df-a66d-49d7-b9b1-4b73752c64dd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.045073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.045989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.046273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.046831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.048005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:17.048373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.050111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.050634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28bf26-9a91-4946-9581-3a7f8ff83b42 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.064598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 275/565] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:17.066717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.096870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:17.098301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.099105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.099298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.099629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.112313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:17.117852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:17.118822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:17.119679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:17.124668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 291/566] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:17.125646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.216430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:17.250816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be48edf-23d3-4e24-b02b-e6d9a8fcef7d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.256007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec5d5-7fe9-4707-81b5-13042865fac6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.296623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.297256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.297574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.297834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.298489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:17.298794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.300404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.302679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.303508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.303660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.303869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.316537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 292/567] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:17.317324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.325684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.327277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:17.340658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:17.342645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 276/568] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:17.344481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.469590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:17.485429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f217e-af16-475b-8632-a4b7b874303d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.506332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2277a-31e5-4e07-ab8c-9aa7f806fd6a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.546472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.547108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.547392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.547669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.548388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:17.548702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.550128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.551401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.552697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.553367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.553867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.557891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:17.561847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 277/569] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:17.562737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.574230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.577598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:17.601972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:17.603139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:17.604155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:17.604155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:17.604155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:17.605657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 293/570] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:17.607520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.707662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9209b5-c505-4ee0-9a8b-e9e9566cef94 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.735654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6e76-4a35-4ee0-992a-3a0f520f8d38 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:17.749766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.750405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.750685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.750960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.751715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=3666250d3b11459e84b2e3b672f9ba3c) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:17.752031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.753583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.757017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:17.761068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 278/571] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/role_assignments?user.id=3666250d3b11459e84b2e3b672f9ba3c&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:17.762694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.802546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:17.804030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:17.804730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:17.805332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:17.806914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:17.807387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:17.810704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:17.853042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 294/572] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:17.853042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:17.937090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:17.941507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd21a-926b-4bf0-8d12-954b5fd9ea79 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.009846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.010681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.011039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.011389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.026015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:18.028206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:18.036051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70469360-261b-4902-b778-4c5a6bcd15d0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-dd1009e2-0419-4228-a939-9e9f14c824bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:18.047680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:18.049523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:18.051230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:18.051230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:18.051230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:18.053839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 279/573] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:18.054992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a861a9-a874-4ddf-920b-442d390eadb9 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.055283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a861a9-a874-4ddf-920b-442d390eadb9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.055571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a861a9-a874-4ddf-920b-442d390eadb9 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.063751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 280/574] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:18.063751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a861a9-a874-4ddf-920b-442d390eadb9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:18.092112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.092787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.093066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.093344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.094018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:18.094326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:18.095745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:18.110102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 295/575] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:18.110887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:18.179024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:18.255757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a861a9-a874-4ddf-920b-442d390eadb9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.299011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153239a4-9fc8-4d29-9d43-76a5203990cc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.304286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:18.332359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.334366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.334851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.335326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.349449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.350493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.351002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.351488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.352685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:18.353207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:18.356473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a466d-bce9-4f80-98ab-f378233711c0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:18.361284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:18.361725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:18.386109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 296/576] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:18.386109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.386109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.386109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:18.390566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:18.391597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:18.392546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:18.392546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:18.392546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:18.399672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 281/577] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:18.401245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:18.421138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:18.423765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:18.550057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 297/578] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:18.551557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:18.602650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11cd6-69e1-42cb-a0e0-07480db09e7c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.607457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:18.676916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.677950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.678537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.679199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.696196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:18.699306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:18.725171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:18.727059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:33:18.729675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:18.732840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 282/579] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:18.734673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:18.760107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:18.774393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221448bb-b079-4848-a2ce-850646fa3b2b None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.840960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.843462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:18.844603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:18.845323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:18.859832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:18.863376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:18.889587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:18.891300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:18.893272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:18.894444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 298/580] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:33:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:18.894576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:18.938572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa745-1a2f-4ad2-9ce1-31b92badbcc3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:18.998269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:18.999735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.000453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.001271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.002388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:19.002812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.005261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:19.030868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 283/581] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:19.030868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.071301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:19.089924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cc46c-f688-424d-8e62-26c1a97e1ea9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.154053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.155120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.155610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.156089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.157512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:19.158053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.160818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:19.186512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 299/582] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Oct 28 09:33:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:19.187963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.210707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:19.213822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3141-126c-477f-887d-b3f23b890a31 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.273947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.275059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.276361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.276732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.292533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:19.299949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:19.310647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 284/583] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:19.312682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.350597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41870b8a-4ac5-4981-964c-bce4a5bc70c1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.420341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.421155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.421562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.422047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.424442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:19.424819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.428184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:19.440352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:19.466629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 300/584] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:19.466629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.478301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ac2a0-4b9f-45bd-9b36-c9f67319860f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.531551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.532484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.532904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.533309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.543428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.545516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:19.559571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:19.564587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:19.566337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:19.568039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:19.572500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 285/585] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:19.575342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.607138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aecfc-b5cf-47b6-9fda-9f9dc7826c4f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.670363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.671374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.671834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.672317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.691505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.693656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:19.720161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:19.722268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:19.724021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:19.724021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:19.724021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:19.724021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 301/586] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:19.724021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.751860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28820b-7e68-4961-ba18-affdefd62c34 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.806270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.806908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.807191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.807516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.808273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:19.808768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.810230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:19.820396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 286/587] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:19.821285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:19.833223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:19.909896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572cf1f-ed76-4687-a96c-c90e400ce23a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.957383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:19.963407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebeff7-4607-4b58-a8a9-372c600a4598 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:19.975667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:19.976872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:19.977039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:19.977299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:19.992180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:19.993709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.012265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:20.012829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:20.022702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:20.023576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:20.023576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:20.023576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:20.023838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.023838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.023838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.024055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 302/588] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:20.024055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.024323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:20.024323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.024323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.039274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 287/589] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:20.040501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.129419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:20.173952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366398f-4552-45d1-a0d6-de7b2e937569 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:20.181519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a05f7-75d5-45d5-a8fe-02520a599b9e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:20.223613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.224748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.225280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.225876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.227058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:20.227654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.229903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.230410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.231470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.232333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.232611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.252003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.258162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 303/590] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:20.258360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.258441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:20.286741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:20.288868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:20.290625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:20.290625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:20.290625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:20.290625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 288/591] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:20.290625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.323687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:20.440022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d82fa5-2fb4-49be-8f2e-7e18beb254dc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:20.446201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bdfe5-00d8-4dc3-9916-a64c398ef1c5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:20.471109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:20.490448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.491406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.491849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.492426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.493500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:20.494073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.497164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.504435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.505718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.506185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.506655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/a6b9ce9facf54e809bd8e569b27a6791/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.516316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 304/592] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:20.517656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.530857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=a6b9ce9facf54e809bd8e569b27a6791, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.533289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.552412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 289/593] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:20 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/a6b9ce9facf54e809bd8e569b27a6791/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:20.553351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.725542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:20.741427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42f823-f58f-4017-8e71-389c2ca7c7e0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:20.787158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130f263-e7ad-4d0a-9e02-2665d5b36e92 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:20.807522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.809327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.810042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.810526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.830826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.833325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.845913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:20.847410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:20.848487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:20.849285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:20.850695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:20.852274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:20.854118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 305/594] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:20.856304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:20.857303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:20.858037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.861068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:20.887332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 290/595] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:20.896434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:20.953475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:20.992537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25152-a0fe-422b-88da-0df0859f168c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.038349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.039009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.039281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.039551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.047915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.049464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.061486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd7444-2a95-4cda-bb75-6b88ae74f6b9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:21.072893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:21.073869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:21.075198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:21.080440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 306/596] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:21.082083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:21.105319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:21.109456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.111245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.111849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.112401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.113580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:21.114022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.117234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d8419-25bc-4e23-bf95-42f7b394613d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.140169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 291/597] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:21.142325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6edd-4f9b-4bb6-ae69-7b42dab71e5c None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.142726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6edd-4f9b-4bb6-ae69-7b42dab71e5c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.143165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6edd-4f9b-4bb6-ae69-7b42dab71e5c None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.145733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 292/598] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:21.147045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d6edd-4f9b-4bb6-ae69-7b42dab71e5c None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:21.247945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148851fc-8bca-48cd-b514-91b1c8716d4a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.258792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:21.275264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d6edd-4f9b-4bb6-ae69-7b42dab71e5c None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.303823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.304801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.305197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.305576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.318935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.319499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.320132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.320446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.320721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.321422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.321520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:21.321789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.323304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.343899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 293/599] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:21.343899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a001a921-1151-4c40-aa1d-dfa1d26cbbd0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:21.344312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:21.345375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:33:21.346485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:21.347508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 307/600] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:21.348950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.349332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.349718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.374280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:21.375502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:21.473742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 308/601] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:21.475173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:21.485983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:21.487139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bba8c-d396-4306-ad50-3eafc2439744 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.539269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.539887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.540291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.540735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/3233db58d77647ba9687c8d51a427eb6/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.560695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=3233db58d77647ba9687c8d51a427eb6, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.562615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.575629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:21.584620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 294/602] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:21 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/3233db58d77647ba9687c8d51a427eb6/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:21.586083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:21.641469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fc40e-1c90-4149-b52d-2c4ffe94d8d1 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.688907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.689901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.690586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.691014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/7b34a8c7d4f242c3a5be691db48cc0d5/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.710862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=7b34a8c7d4f242c3a5be691db48cc0d5, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.712709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.729724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 309/603] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:21 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/7b34a8c7d4f242c3a5be691db48cc0d5/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:21.806952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c469-3e60-4df7-85ee-f5d2aabe2083 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:21.879210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:21.880184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:21.880654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:21.881071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:21.882324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:21.882796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:21.885600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:21.922529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 295/604] 10.222.0.44 () {56 vars in 1139 bytes} [Fri Oct 28 09:33:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:21.931484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:22.046791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:22.074973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:22.126638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0a65c-f893-479d-b3c4-69d6a8183c13 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:22.213477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:22.215647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:22.216102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:22.216599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:22.221817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:22.240957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:22.244273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:22.287600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:22.289233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:22.291228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:22.291228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:22.291228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:22.291228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 310/605] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:22.300376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:22.338814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007e184-deb3-4d01-89e3-cb2ea51e3ab4 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:22.482601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:22.483704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:22.484211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:22.484861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:22.524339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:22.525782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:22.528295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:22.530714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:22.540426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 296/606] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:22.545119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:22.602397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0bc5-4c68-4123-8875-50027e8f6d1a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:22.616789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:22.685326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:22.686393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:22.686888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:22.687350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:22.688569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:22.689063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:22.691696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:22.716177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 311/607] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:22.725235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:22.804367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa492e-9df1-4b51-9452-d529d0488c6b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:22.836796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:22.880206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:22.880765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:22.881038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:22.881326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:22.882083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:22.882390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:22.883804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:22.908163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 297/608] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:22.917035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:22.935790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bfdc-5a31-4b11-91f7-4b0f28d86313 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:22.983848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:22.984935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:22.990972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:22.991568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:23.014553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:23.017315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:23.055465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:23.057309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:23.059532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:23.064866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 312/609] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:23.074274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:23.134530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:23.248668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa908392-c732-41e7-a317-abca83bdf7d3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:23.323260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:23.325708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:23.326507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:23.327323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:23.350240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:23.353266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:23.375662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c8ea5-dbfb-4c11-a847-27380c17c634 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:23.400554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:23.402345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:23.404739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:23.404739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:23.404739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:23.409795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 298/610] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:23.414527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:23.515089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:23.516112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:23.516621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:23.517097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:23.518358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:23.518890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:23.520217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:23.522886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:23.566889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 313/611] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:23.573774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:23.761549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84968b11-458f-4a76-a274-4dbb87d661e6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:23.802967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:23.844685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b280c68-dff8-4ede-b009-2092e282b59c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:23.862201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:23.862839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:23.863106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:23.863375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:23.864034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:23.864370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:23.865815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:23.896307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 299/612] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:23.905983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:23.936903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:23.937833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:23.937833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:23.938298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/828e306d81f64846b2b8f07b3dd1e5a4/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:23.978544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=828e306d81f64846b2b8f07b3dd1e5a4, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:23.982131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:24.032461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 314/613] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:23 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/828e306d81f64846b2b8f07b3dd1e5a4/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:24.068444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:24.081925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1e30d-0dfa-4268-9c1a-9ffc8fdd14ff None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:24.132409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:24.133101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:24.133385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:24.133665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:24.144386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:24.145935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-0d2d1c96-5505-4bf6-9022-b848f9853b10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:24.167996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:24.171620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:24.175412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 300/614] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:24.183674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:24.359170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45325e48-830a-4757-b00e-3da3591a579d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:24.404393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:24.405039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:24.405321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:24.405598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:24.406372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:24.406682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:24.408159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:24.411671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:24.437540 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 315/615] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Oct 28 09:33:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:24.444207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20070c0d-545f-46ff-a5ed-e9f62e51f58d None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:24.444556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20070c0d-545f-46ff-a5ed-e9f62e51f58d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:24.444808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20070c0d-545f-46ff-a5ed-e9f62e51f58d None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:24.446361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 301/616] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:24.447294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:24.453479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:24.453789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:24.454029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:24.484088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:24.485400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:24.639182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 302/617] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:24.680970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be349-20f5-4a42-8473-4637279de19e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:24.754972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:24.755883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:24.756404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:24.756820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:24.775309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:24.778736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:24.819623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:24.820832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:24.821701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:24.821701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:24.821701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:24.822600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 316/618] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:24.829681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:24.972008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:25.003788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d9f55-7618-4ec0-b81f-ad6a94759b63 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:25.066270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:25.066914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.067192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.067468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.068165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:25.068512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:25.069970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:25.086909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 303/619] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:25.094137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:25.165475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:25.208867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:25.330316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16cc2-4733-41e9-857c-8a12d05310d2 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:25.405218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:25.406123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.406511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.406916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.441476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:25.444298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:25.476230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:25.477483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:25.478693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 317/620] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:25.489643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:25.529227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d52194-3da8-4d27-8e48-30441a51e1a8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:25.616969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:25.617979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.618556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.619053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.640573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:25.650874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:25.659289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:25.661546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:25.663752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 304/621] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:25.671467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:25.794138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c350b-0da2-4a48-bd24-eee8ad50fc0f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:25.802382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff5b69-494b-49f6-aa4c-c1c41a26751d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:25.813948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:25.850543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:25.851426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.851426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.851935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.852483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:25.852795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:25.854315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992bebc-fb39-46d1-baa3-1737a15c50aa None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:25.866823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 305/622] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:25.868542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0060c-a640-4afb-aa09-a2f06ea7f261 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.868728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0060c-a640-4afb-aa09-a2f06ea7f261 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.869000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0060c-a640-4afb-aa09-a2f06ea7f261 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.870485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 306/623] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:25.876973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0060c-a640-4afb-aa09-a2f06ea7f261 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:25.882437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:25.883887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.884717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.885420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.887894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:25.888855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:25.891906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51833d-5434-431d-8c42-c42c1978c234 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:25.923383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 318/624] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:25.926469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f146cb-2881-4901-a152-244455fde740 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:25.927303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f146cb-2881-4901-a152-244455fde740 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:25.928008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f146cb-2881-4901-a152-244455fde740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:25.964481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:25.965416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c7f146cb-2881-4901-a152-244455fde740 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:25.967451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c7f146cb-2881-4901-a152-244455fde740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:26.009741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0060c-a640-4afb-aa09-a2f06ea7f261 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.052022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 319/625] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:26.053138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f146cb-2881-4901-a152-244455fde740 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.053928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.054783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.055129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.055466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.068787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:26.070500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-213d1481-efbb-4808-9eef-25b90047bcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:26.087886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:26.089139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:26.090263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:26.090263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:26.090263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:26.091239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 307/626] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:26.092787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fab74-8a05-4daa-b552-ea781e9e430b None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.093072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fab74-8a05-4daa-b552-ea781e9e430b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.093357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fab74-8a05-4daa-b552-ea781e9e430b None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.095093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 308/627] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:26.105520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fab74-8a05-4daa-b552-ea781e9e430b None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.208820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:26.219523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f146cb-2881-4901-a152-244455fde740 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.229233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fab74-8a05-4daa-b552-ea781e9e430b None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.245251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:26.276325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.276962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.277252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.278408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.279270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:26.279583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:26.281239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09681356-1eb7-416f-a358-0b1ec5c1ddb2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:26.296397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.298334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.298844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.299745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/3666250d3b11459e84b2e3b672f9ba3c/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.300311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 309/628] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:26.301726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.302056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.302332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.323253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:26.324651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:26.335022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=3666250d3b11459e84b2e3b672f9ba3c, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:26.337539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:26.372791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 320/629] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:26 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/3666250d3b11459e84b2e3b672f9ba3c/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:26.374565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.422449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 310/630] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:26.423312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.560030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58395f-d33c-4405-ae15-021376c9ac29 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.605541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.606905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.607202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.607477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.630384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:26.631347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1824f9-84a6-43bd-b873-e97fbb940f3a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.633499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:26.634348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:26.677748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.678412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.678703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.679405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:26.688103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:26.689981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:26.691867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 321/631] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:26.694550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:26.699942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:26.703887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:26.707562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 311/632] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:26.717910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.717910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:26.721640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.861887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db5df0-a7d0-44ed-be23-f6a466c6edf3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.917520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b238d-fefc-423d-b962-8d90387d3914 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:26.940571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.942264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.942744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.943198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.945385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:26.945941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:26.950916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:26.965787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:26.966416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:26.966695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:26.967043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:26.967656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:26.967966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:26.969845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:26.981479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 322/633] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:26.982370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:26.993814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 312/634] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:26.994690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:27.055471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:27.124072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:27.178880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce954c0-0e94-4b4c-8065-fe7f717347e7 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:27.211485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354a3-e865-45a9-b648-6a63ef7e8543 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:27.250596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:27.251783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.252672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.253340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.266933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:27.267720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.268007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.268313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.282264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:27.284440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:27.285005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:27.290370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:27.291639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:27.292922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 323/635] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:27.294350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:27.318223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:27.320793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:27.323186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:27.323186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:27.323186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:27.323186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 313/636] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:27.323186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:27.466010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e78f8-17b3-4c0d-8386-a6a87c0a4822 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:27.473467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:27.497385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:27.507711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:27.508378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.508660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.508941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.524711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44705be-0794-4779-b283-e03d89e65182 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:27.587326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:27.588714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.589429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.589940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.592231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:27.592775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:27.594343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e64bd-f4e8-48dc-bab0-21499c475f78 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:27.597669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:27.599330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:27.611651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 314/637] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:27.611651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e70477-383e-4bf8-beeb-350ef7e23acf None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.611651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e70477-383e-4bf8-beeb-350ef7e23acf None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.611651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e70477-383e-4bf8-beeb-350ef7e23acf None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.616297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 315/638] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:27.616297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e70477-383e-4bf8-beeb-350ef7e23acf None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:27.747728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 324/639] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:27.748689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:27.767698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e70477-383e-4bf8-beeb-350ef7e23acf None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:27.789698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:27.811820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:27.812593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.812940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.813284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.814033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:27.814404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:27.815880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69865c1d-6b61-4858-ae3e-93d41caa64e4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:27.819313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:27.838308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 316/640] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:27.839579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.839868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.840343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:27.862552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:27.863804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:27.931857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee749d29-6e86-4b4b-bed6-c9c491825159 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:27.958594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 317/641] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:27.960923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:27.987113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:27.987775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:27.988050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:27.988373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.005230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.006763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:28.026986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:28.028769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:28.030486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:28.030486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:28.030486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:28.033899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 325/642] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:28.035373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.172002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:28.180001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d33a6-e563-4e7b-80da-92536ef2f952 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.199492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30fe00-b136-4fa6-b283-a7951d4cd83f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.236755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:28.240824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.242371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.242798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.243221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.251844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.253177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.253872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.254438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.255504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.257309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:28.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:28.272964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:28.273899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:28.276891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.277253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 326/643] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:28.278977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.280799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:28.310286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:28.311423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:28.312640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:28.312640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:28.312640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:28.319366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 318/644] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:28.321077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.407652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4e41-6c01-4178-965d-0bee6c9be834 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.453183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.454179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.454743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.455227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.456086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:28.456697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.458345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.469592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:28.476558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 327/645] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:28.477945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.501035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89fd77-d108-4d2f-a750-ff1fb4f35eef None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.550801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.551703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.552151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.552862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.553626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:28.554068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.555820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.578457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 319/646] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:28.579634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.626773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:28.627333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c513a-0789-49eb-978a-1785d491283a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.686420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.687214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.687680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.688142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.689271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:28.689791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.692292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.717707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 328/647] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:28.717707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.747271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d6d7-f5d8-4c5c-a570-78dcc37e6452 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.808585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.810479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:28.811725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.812482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.813399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.826693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:28.829238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:28.850422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:28.851457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:28.852421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 320/648] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:28.853658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:28.884186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dcf2-cee4-4a6c-a1ab-76ff8f440b21 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:28.940502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:28.941473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:28.941906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:28.942343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:28.960659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:28.970979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:28.971992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:28.972906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 329/649] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:28.974118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.031487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:29.046189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56dfd-44ab-4642-b033-8b1acf9b7ff3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.114369 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.115364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.115801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.116276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.145164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c22c-7efc-43e2-a943-195d95cf5cf8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.168168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:29.187307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.188341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.188842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.189274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.197565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:29.200030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:29.216845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:29.218582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:29.221128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:29.222809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 330/650] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:29.223813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.242044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:29.244363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:29.398518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3787b7-e01d-44c1-bdc5-1cf7308e819a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.408047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:29.425355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 321/651] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:29.425355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.489606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.492068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.492623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.493113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.494531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:29.495073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:29.497991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:29.535752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 331/652] 10.222.0.44 () {56 vars in 1137 bytes} [Fri Oct 28 09:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:29.535752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.588730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:29.598172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf7c35-93ab-41d2-ad1b-b44538964d9d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.657681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.658253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.658545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.658816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.659579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:29.659880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:29.661337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:29.671266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f6e8-cf23-443f-a223-469ad411bc36 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.672328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 322/653] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:29.673893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.723036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.723928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.724353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.724756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.725881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:29.726316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:29.728494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:29.754052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 332/654] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:29.754052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.773278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:29.833740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2b21-e83e-486d-a5a8-6bb3ff144cf8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.875522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.876337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.876700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.877067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.890104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:29.891586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:29.907234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-1a373cc0-5121-48c0-b85e-7fa6a72fff86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:29.908401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:29.910418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 323/655] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e937d-c4f0-40d2-bf14-c7c75ee98cb4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e937d-c4f0-40d2-bf14-c7c75ee98cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.912527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e937d-c4f0-40d2-bf14-c7c75ee98cb4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:29.914670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 324/656] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:29.914670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e937d-c4f0-40d2-bf14-c7c75ee98cb4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:29.921052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e940724-df99-4ac5-8d60-21eb1db3959a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:29.969636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:29.970254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:29.970528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:29.970796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.064764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.067565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.088789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e937d-c4f0-40d2-bf14-c7c75ee98cb4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.108104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:30.139077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.139910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.140354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.140821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.155765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.157317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:30.174428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:30.175466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:30.176627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:30.176627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:30.176627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:30.176627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 325/657] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:30.176627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.205026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:30.212149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 333/658] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:30.213792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.323175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf3c5-98dd-4735-b28b-9de340295d62 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.380270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.380897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.381177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.381451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.381761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32506a6-db8b-4094-aa83-66d34820aaa9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.382197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=a6b9ce9facf54e809bd8e569b27a6791) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:30.382506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.383989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041e3fa-09f7-486a-96b0-05f0c39df70e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.391362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 326/659] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/role_assignments?user.id=a6b9ce9facf54e809bd8e569b27a6791&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:30.392798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.393086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.393364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.432850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:30.434546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.435495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:30.435654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.435802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.436069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.436763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:30.437069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.438799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.464290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 334/660] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:30.464290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.478563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:30.543290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 327/661] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:30.545000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.571525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:30.641024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0133f4-1be5-4d25-9ddb-f01d50c1ae4b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.691472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.692013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.692315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.692588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.693250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:30.693552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.694807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591144c5-7c5a-4a6c-82c5-9c76bd9a1c4d None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.696018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.717948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 335/662] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:30.719713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.754729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.755432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.755711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.755986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.780010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.782282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:30.805279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:30.806295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:30.807668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:30.807668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:30.807668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:30.807668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 328/663] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:30.807668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:30.824897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:30.871301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c2409-df76-41a0-be8d-8dde230ccc2e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:30.898633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:30.934635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:30.936397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:30.937501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:30.939036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:30.958642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:30.963306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:30.963646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857328b-8f6e-4edc-993c-ce917b96e6ba None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:31.000998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:31.002750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 336/664] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:31.012430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.025007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.026036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.026480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.026921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.038193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.040111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:31.056466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:31.057539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 329/665] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:31.059842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.164315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:31.173828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8efa3c-d1bf-4050-8f7c-6a782cfa4038 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.234137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a52ea0-3d05-43b8-a88c-30ad7c4b1b38 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.242919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.244002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.244547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.245044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.247109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:31.247630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.250427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.275021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 337/666] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:31.276633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.292013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.294880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.294880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.295244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.308842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:31.315080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:31.317226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 330/667] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:31.318882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.376723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:31.471299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19f88c-42f3-411f-9bcc-79a8ee29992c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.492760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800ae13-ee3c-4e98-8fe3-cba8593d982a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.521836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:31.536817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.537839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.538341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.538796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.540189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:31.540749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.543834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.566079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.567580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.568385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.569155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.570699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:31.571505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.575265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.578548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 331/668] 10.222.0.44 () {56 vars in 1139 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:31.580118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.606436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 338/669] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:31.608370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.780678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafaf8-6ebc-48f7-bae9-c25e3907d4bf None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.787276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:31.792328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5285a9-15c4-4b0a-9d80-c987cf00f237 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:31.848268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.849054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.849326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.849594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.859043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.860626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.860798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:31.861680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:31.862170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:31.862865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:31.863824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:31.864586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:31.866962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:31.874868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:31.876713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:31.878444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:31.881390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 332/670] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:31.882221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.888019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 339/671] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:31.889266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:31.946872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:32.022494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3444f9-701b-4101-9c00-9a3e5665e125 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.072898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baef38-94b5-480a-be84-7bbc63c769be None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.076328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:32.078099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:32.078099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:32.078388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:32.126824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:32.128040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:32.128513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:32.129246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:32.130313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=7b34a8c7d4f242c3a5be691db48cc0d5) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:32.130749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:32.132621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:32.142124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 340/672] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/role_assignments?user.id=7b34a8c7d4f242c3a5be691db48cc0d5&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:32.143582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:32.174776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:32.177198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:32.197250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:32.260048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:32.335654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72858f24-519b-4a95-b612-def1d819e00e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.392826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 333/673] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:32.394623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:32.416900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:32.420635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:32.420635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:32.420635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:32.420635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:32.420635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:32.422005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:32.438010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 341/674] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:32.438933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:32.579350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:32.583826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491ca5-d78a-4b65-8602-0950a0b021a0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.612863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658f97b-6c42-4877-9107-6bfcb8bead6a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.620777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:32.621535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:32.621817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:32.622094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:32.633705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:32.635353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:32.644368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:32.654365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:32.656561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:32.658601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:32.658601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:32.658601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:32.668407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 334/675] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:32.668407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:32.690094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:32.691349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:32.691629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:32.691898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:32.706480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:32.707995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:32.729465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:32.731856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:32.733544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:32.733544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:32.733544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:32.733544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 342/676] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:32.733544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:32.889410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626ec3b-3323-4e7d-8c54-98d1a54a199e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.918611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41f1ee-29ba-4d2e-87aa-f81827e0d0c5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:32.957270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:32.958734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:32.959622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:32.960389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:32.961954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=3233db58d77647ba9687c8d51a427eb6) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:32.962764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:32.966112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:32.984521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 335/677] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:32 2022] GET /identity/v3/role_assignments?user.id=3233db58d77647ba9687c8d51a427eb6&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:32.984521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.003775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a69a00-2240-43e9-a356-98643629464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.005590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a69a00-2240-43e9-a356-98643629464d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.006347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a69a00-2240-43e9-a356-98643629464d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.007851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a69a00-2240-43e9-a356-98643629464d None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.009470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a69a00-2240-43e9-a356-98643629464d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:33.010392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a69a00-2240-43e9-a356-98643629464d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.013979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a69a00-2240-43e9-a356-98643629464d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.024824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.046067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 343/678] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:33.054547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a69a00-2240-43e9-a356-98643629464d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.140130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.202210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9af31-f025-44ca-bd11-31b9b25752e0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.245540 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.246347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.246661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.247121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.247812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:33.248121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.249597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.265687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 336/679] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:33.273759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.366433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a69a00-2240-43e9-a356-98643629464d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.397787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf4b55-707c-4395-8e78-a23151f82f41 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.427170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.449236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.451496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.452001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.452563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.455500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.456877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.457366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.458357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] PATH_INFO: `/v3/users/swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.466623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.469164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.469545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.471214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:33.485536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:33.486582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:33.487510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:33.490267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 344/680] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:33.495997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:33.498063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:33.498982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:33.499897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 337/681] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:33.505416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.508641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.576534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:33.631237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ccf20-2960-4227-93b6-eecf7c726d5f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.675357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.676377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.676883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.677357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.678308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:33.678818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.680535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.702980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 345/682] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:33.714176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.752274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df5a3c-80b3-4d78-a131-6ab040814a0e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.869839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:33.871050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:33.872288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:33.872807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:33.874151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:33.875382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:33.880174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:33.905775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 338/683] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:33.912599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:33.942179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf74e64-9df3-46c8-a408-51f32ea813e7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:33.961525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.018555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.019554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.020035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.020523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.028633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.162056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4aa68-b8fe-4980-bbd1-0a83564b7f6e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.219170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.219806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.220051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.220360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.221195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=828e306d81f64846b2b8f07b3dd1e5a4) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:34.221515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.223247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e382a-ac9a-478e-a26e-27fe1d3f2c60 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.230430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 339/684] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/role_assignments?user.id=828e306d81f64846b2b8f07b3dd1e5a4&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:34.250799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.252409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.369811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0d4c-c099-4596-8710-4b1c6bb97f1e None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.370295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0d4c-c099-4596-8710-4b1c6bb97f1e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.370787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0d4c-c099-4596-8710-4b1c6bb97f1e None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.378583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 340/685] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:34.388407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.388798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.389162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.413838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 346/686] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:34.421700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.433537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:34.441206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:34.468673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.607303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9770c-8c1a-44cc-87b5-e3fd1b5dc870 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.647348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 341/687] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:34.662571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.663310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.663509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.663780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.678148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.679655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:34.702274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:34.703322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:34.704262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:34.704262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:34.704262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:34.704262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 347/688] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:34.710409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:34.780706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:34.898061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569e0f9-9bb0-4e15-8751-24f2adaca9e9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:34.973912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:34.975074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:34.975543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:34.976014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:34.977331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:34.977852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:34.980577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:35.006412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 342/689] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:35.016014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:35.028115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:35.192905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:35.200913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:35.206401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d36e-3d7b-43cf-a133-9a234aaff2cb None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:35.262132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:35.263178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.263321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.263717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.268302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:35.268302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:35.275567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9cf7-699d-4e95-b074-99734dbbdcc2 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:35.300098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:35.302076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:35.303721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 343/690] 10.222.0.44 () {56 vars in 1129 bytes} [Fri Oct 28 09:33:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:35.311535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:35.376276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:35.376276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.376276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.376276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.390793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:35.392328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:35.422384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:35.424291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:35.426085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 348/691] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:35.445650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:35.569802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755cbda-ad5f-4bc1-acb4-954e2b52362a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:35.600030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2dfd0-3053-48b5-bd6c-7c2c01f23da5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:35.615479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:35.616109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.616421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.616697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.617353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:35.617658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:35.619481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457d62-3fef-490f-a63c-290d73b32e60 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:35.625036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 344/692] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Oct 28 09:33:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:35.626359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd835-76da-4c4a-9660-cca897b1e055 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.626642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd835-76da-4c4a-9660-cca897b1e055 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.626918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd835-76da-4c4a-9660-cca897b1e055 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.632719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 345/693] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:35.633676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd835-76da-4c4a-9660-cca897b1e055 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:35.665882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:35.666897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:35.691706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:35.693538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.694632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.695639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.697049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:35.698111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:35.702960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6668df-6f28-4c2c-be6d-e599fb9b9843 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:35.740582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 349/694] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:35.740835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.741832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.741832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.767627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:35.768723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:35.800758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd835-76da-4c4a-9660-cca897b1e055 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:35.868659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 350/695] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:35.869757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:35.886520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:35.888090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:35.888911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:35.889636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:35.891807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:35.892750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:35.896427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:35.911189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 346/696] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Oct 28 09:33:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:36.062481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ddbe4-48db-40ba-9ae8-1a43585ab834 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:36.098700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:36.136758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:36.138027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:36.138172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:36.138538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:36.139192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=3666250d3b11459e84b2e3b672f9ba3c) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:36.139497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:36.141033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:36.151886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 351/697] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:35 2022] GET /identity/v3/role_assignments?user.id=3666250d3b11459e84b2e3b672f9ba3c&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:36.433029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:36.612053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:36.637880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0e95-1e66-420d-8aef-69eb3feb9bbd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:36.726152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:36.727270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:36.727762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:36.728269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:36.744346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:36.750752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:36.752605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:36.754256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 347/698] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:36.761126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:37.033151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa324a9-e27a-4391-ba2e-affe76d71de7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:37.118667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:37.119301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.119578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.119856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.120601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:37.120904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:37.122765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:37.138774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 352/699] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:37.146636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:37.315625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2bcc7-0b14-4925-aa61-1662c1974071 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:37.379159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:37.379826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.380109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.380432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.396751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:37.398269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6e96cbc9-b4ab-4e34-ae9f-2c9bbdf2ee24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:37.421320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:37.423194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:37.426285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:37.426285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:37.426285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:37.426285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:37.442975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 348/700] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:37.443286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:37.498286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de97a5-6860-4eb6-8227-39f42534e2e2 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.499491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de97a5-6860-4eb6-8227-39f42534e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.500495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de97a5-6860-4eb6-8227-39f42534e2e2 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.504041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 349/701] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:37.515028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.515931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.516709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.554628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:37.555882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:37.568466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:37.673683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813130-9d8f-4e54-9cab-287f50c02035 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:37.720583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 350/702] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:37.765710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:37.766713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.767203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.767684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.768997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:37.769594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:37.772225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730371fa-205d-4486-bcff-f0262ea223c7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:37.806901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 353/703] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:37.816345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:37.960791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0ba8-54d6-4dd2-89ef-18276a659bee None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.968334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0ba8-54d6-4dd2-89ef-18276a659bee None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.969580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0ba8-54d6-4dd2-89ef-18276a659bee None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:37.972728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 354/704] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:37 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:37.978925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:37.979823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:37.980588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.030255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:38.034920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:38.119611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3dd197-63f6-4201-964e-35e8d2ab49a0 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.183561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.194058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.195735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.196612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.197388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.212585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.216505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.237545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 355/705] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:38.239209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:38.241458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:38.243171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:38.245070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:38.250086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 351/706] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:33:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:38.272288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.311160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.458137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1258317-36b5-4a34-b673-51908c6cfa24 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.525390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.526351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.526854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.527254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.547681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.550633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:38.582794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:38.584498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:38.585972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:38.585972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:38.585972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:38.585972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 356/707] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:38.592484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.616463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be99e0-5497-4959-bced-f82ce1d46b87 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.723091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.723986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.724445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.724870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.725769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:38.726300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.727964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.767344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 352/708] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:38.783238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:38.788994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.825642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876e571-1873-4920-87a2-ea7c6eb40373 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:38.891679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:38.899869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:38.902551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:38.903470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:38.904225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:38.905975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:38.907036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:38.910198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:38.935762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 357/709] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:38.937894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.007077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50702-ccdd-4545-9419-cd3941132c11 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.078771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc527-b6d8-40e0-9666-373dbf328805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.079471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc527-b6d8-40e0-9666-373dbf328805 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.079781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc527-b6d8-40e0-9666-373dbf328805 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.080059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc527-b6d8-40e0-9666-373dbf328805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.104423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d7bc-cee1-4a3f-93eb-0ea0c85fe465 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.159027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.160266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.160698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.160986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] PATH_INFO: `/v3/services/network` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.161594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.163425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.167404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc527-b6d8-40e0-9666-373dbf328805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.169634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc527-b6d8-40e0-9666-373dbf328805 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:39.179967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:39.182165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:39.184852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 358/710] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:39.187129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.199107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.243324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.307242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 353/711] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:33:39.309778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d79f-33ff-4cd7-9452-200cf94e2987 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.310137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d79f-33ff-4cd7-9452-200cf94e2987 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.310536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d79f-33ff-4cd7-9452-200cf94e2987 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.312570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 354/712] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:39.313225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122d79f-33ff-4cd7-9452-200cf94e2987 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.342012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567854fa-63b3-4895-9568-afaa6a3e4c84 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.390167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.390795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.391202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.391359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.392001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.393548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.428275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 359/713] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:33:39 2022] POST /identity/v3/users => generated 254 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:39.428275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.473413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122d79f-33ff-4cd7-9452-200cf94e2987 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.536025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.564432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.566461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.566917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.568062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.569572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:39.570082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.574082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad164d-875a-493a-85c1-e65f988c95d8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.585138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 355/714] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:33:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:39.587329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.587921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.588478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.607741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853f534-20e0-4694-b54c-278fefc45980 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.632878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:39.635671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:39.658954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.661169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:39.661982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:39.662361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:39.662763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:39.681514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:39.683710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:39.707754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:39.709922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:39.712061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:39.712061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:39.712061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:39.714964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 360/715] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:39.715768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.798282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 356/716] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:39.800333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:39.927254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecdaea-7965-43f0-9636-1066e7fb892e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:39.966575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:39.984024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69a4b5-67fc-446f-88c3-c587fe442097 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:40.008444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:40.009911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:40.011284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:40.012448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:40.014017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] RBAC: Adding query filter params (type=network) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:40.014850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:40.018570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1ea03-5a1b-40b4-a44d-d8a74e1ef545 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:40.031798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 361/717] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:33:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:40.034850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75691f-622c-40ec-ab2e-f1556ecfd4a5 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:40.035663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75691f-622c-40ec-ab2e-f1556ecfd4a5 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:40.036487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75691f-622c-40ec-ab2e-f1556ecfd4a5 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:40.039846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 362/718] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:40.050451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:40.051530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:40.051530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:40.083586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:40.085772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:40.104163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:40.105324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:40.106344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:40.106829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:40.108007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:40.108484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:40.110650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:40.135536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 357/719] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:40.137511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:40.152028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:40.238260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 363/720] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:40.239953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:40.497902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34448e1-edfb-434f-8a1f-ecd83bceb0d3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:40.507883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a9438-22bb-4d14-bf0d-b87bbba47021 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:40.536790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:40.599173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:40.600285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:40.600785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:40.601263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:40.604542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:40.605617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:40.606757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:40.607425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:40.609212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:40.612167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:40.629727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:40.631214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:40.658970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:40.660793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:40.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 364/721] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:40.671009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:40.678406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 358/722] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:33:40 2022] POST /identity/v3/services => generated 251 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:40.867189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:40.964551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2f627-50e0-4c1b-a38e-293c873e1f88 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:41.085757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:41.108356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:41.109288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:41.109684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:41.110073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:41.111151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:41.111663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:41.113993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:41.142190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 365/723] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:41.148653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:41.186933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d600d2-808d-48f0-867e-d5af63a78188 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:41.209483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:41.266279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:41.267961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:41.268851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:41.269777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:41.293930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:41.306959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:41.309567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:41.311411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:41.316553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 359/724] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:41.326569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:41.372288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b278da-7bf0-4be0-8332-ac780e8b0828 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:41.452224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:41.453250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:41.453734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:41.454211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:41.455674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=862360b634994703825014c6d7c129f0, user.id=7b34a8c7d4f242c3a5be691db48cc0d5) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:41.456319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:41.459084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:41.471110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 366/725] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:41 2022] GET /identity/v3/role_assignments?user.id=7b34a8c7d4f242c3a5be691db48cc0d5&scope.project.id=862360b634994703825014c6d7c129f0&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:41.583591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e2d81-f297-40f4-a6ce-898cf225637b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:41.615482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:41.640152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:41.640857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:41.641142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:41.641422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:41.642204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:41.642577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:41.644231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:41.661181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 360/726] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:41.670372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:41.909577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:41.930551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa6a4-5a29-42d6-bb7e-a76d5b691708 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.001561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.002606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.003085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.003523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.031655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.034506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:42.063889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:42.065151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:42.066071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:42.066071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:42.066071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:42.066868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 367/727] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:42.075520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.321332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb87e-b701-4508-a9ec-226e7e841327 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.417802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.420075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.420592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.421077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.422161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:42.422681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.425194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.458456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 361/728] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:42.467434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.707522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2668-eb15-451a-b51c-7bb1023cd477 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:42.778599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:42.779508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:42.779897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:42.780310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:42.796336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:42.799267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:42.829316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:42.831613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:42.834485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 368/729] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:42.841118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:42.957703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:43.107351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021acaeb-9f1a-422a-adb7-dae1da2f68c9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:43.211304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:43.212275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:43.212769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:43.213255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:43.214691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:43.216801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:43.219053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4914f-1e60-40c7-a59e-5aaf83c3bb16 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:43.271015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 362/730] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Oct 28 09:33:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:43.280034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:43.288892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:43.449491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97730672-4d40-4597-a6d1-1d7784191324 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:43.450875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97730672-4d40-4597-a6d1-1d7784191324 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:43.450875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97730672-4d40-4597-a6d1-1d7784191324 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:43.453348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 363/731] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:43.470592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:43.470996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:43.471404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:43.531267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:43.532742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:43.559733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d1bb-43cd-4425-a1ed-ac75072855d1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:43.613919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e9ea0-0cee-4ec9-b2c0-29ee88cc0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:43.614964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e9ea0-0cee-4ec9-b2c0-29ee88cc0444 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:43.615449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e9ea0-0cee-4ec9-b2c0-29ee88cc0444 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:43.615938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e9ea0-0cee-4ec9-b2c0-29ee88cc0444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:43.761036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 364/732] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:33:43.827579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e9ea0-0cee-4ec9-b2c0-29ee88cc0444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:43.830348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e9ea0-0cee-4ec9-b2c0-29ee88cc0444 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:43.833924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:43.980013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 369/733] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:33:43.988791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:44.008975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d1c5-4da5-43d1-9ecf-921262839727 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:44.009384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d1c5-4da5-43d1-9ecf-921262839727 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:44.009537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d1c5-4da5-43d1-9ecf-921262839727 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:44.011443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 370/734] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:33:44.020287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:44.020745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:44.021190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:44.116868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:44.259219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8462d-962a-4b10-ac4d-15cf7a513ed7 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:44.278058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:44.279286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:44.342711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:44.343378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:44.343658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:44.343936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:44.371409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:44.372985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:44.400569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 371/735] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:33:44.401480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:44.406110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:44.408206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:44.410260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:44.410260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:44.410260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:44.413485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 365/736] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:44.420398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:44.488948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:44.707696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:44.727593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad606-cf74-48af-b5c6-cf8d64ba81c5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:44.730021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d1ca7-0c83-45a6-9cbf-7c6189a97e0c None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:44.766530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:44.767201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:44.767549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:44.767882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:44.768770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:44.769278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:44.770903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:44.790375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 366/737] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:44.791937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:44.804886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:44.806276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:44.806963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:44.807645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:44.830703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:44.842864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:44.844873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:44.846499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:44.852894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 372/738] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:44.852894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:44.962309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:44.973885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626ad6-950b-4daa-b16f-cd8e922f56ff None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:44.976143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754d984-9f1c-4337-b759-75b7a27cef7e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.014855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.015922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.016486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.016977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.025347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.027187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:45.039834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:45.040850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:45.042002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:45.048568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 373/739] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:45.050015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.055402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.056534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.057278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.057984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.060049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.062218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.082179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 367/740] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:33:44 2022] POST /identity/v3/services => generated 240 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:45.083629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.116823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.306893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb11271-3698-47e4-a401-8f3c1b0b2511 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.367264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d27f6-c59a-495a-b460-5dcd1c5cb663 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.395293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.395923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.396204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.396486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.397177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:45.397479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.398910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.441604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 374/741] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:45.444645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.445399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.445714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.445995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.446869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:45.447215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.448786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.458119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.472870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 368/742] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:45.485354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.489299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.615455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a42f-9c42-44dc-b90e-5db6556d1f9e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.619184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.665794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.667064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.667524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.667976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.683575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80d12a-b957-4888-8aed-5ace5c4061d4 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.684397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.686013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8ba08e71-225d-4fcd-9800-6778514fa75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:45.706253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:45.713274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 375/743] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9c9e5-5d69-4824-a052-e535dc9f5f66 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9c9e5-5d69-4824-a052-e535dc9f5f66 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9c9e5-5d69-4824-a052-e535dc9f5f66 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 376/744] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:45.725682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2141-f11d-40f1-9524-22ecc15994ac None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.727625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2141-f11d-40f1-9524-22ecc15994ac None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.727625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2141-f11d-40f1-9524-22ecc15994ac None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.727625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 377/745] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:45.727625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d78f-90bc-4cf5-82c0-139ff63f5db2 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.727625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d78f-90bc-4cf5-82c0-139ff63f5db2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.727625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d78f-90bc-4cf5-82c0-139ff63f5db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.745026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-1aa8d78f-90bc-4cf5-82c0-139ff63f5db2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:45.745259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.745858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.746139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.746943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.747695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=862360b634994703825014c6d7c129f0, user.id=3666250d3b11459e84b2e3b672f9ba3c) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:45.748007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.748617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-1aa8d78f-90bc-4cf5-82c0-139ff63f5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:45.749620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.757362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 369/746] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/role_assignments?user.id=3666250d3b11459e84b2e3b672f9ba3c&scope.project.id=862360b634994703825014c6d7c129f0&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:45.758048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:45.886016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e9b3-0a15-4b83-8f8b-db02605b0800 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:45.888992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.907561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 378/747] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:45.910416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308999f0-a126-47e4-859c-226e4f053aac None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.911301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308999f0-a126-47e4-859c-226e4f053aac None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.912063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308999f0-a126-47e4-859c-226e4f053aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.926224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:45.952712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-308999f0-a126-47e4-859c-226e4f053aac None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:45.953150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:45.953756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:45.954040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:45.954351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:45.954997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:45.955310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:45.956816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:45.958328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-308999f0-a126-47e4-859c-226e4f053aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:45.987789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 370/748] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:45.989129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:46.113090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74329f7a-811e-4878-bf05-c2aba537e044 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:46.114644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 379/749] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:46.201276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:46.202985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:46.203744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:46.204499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:46.229608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:46.234315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:46.264611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308999f0-a126-47e4-859c-226e4f053aac None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:46.266135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:46.267783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:33:46.269631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:46.274243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 371/750] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:33:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:46.283432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:46.391774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308999f0-a126-47e4-859c-226e4f053aac None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:46.433056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:46.464911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:46.481835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:46.482875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:46.482875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:46.483118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:46.483694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:46.485242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:46.504933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:46.506730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:46.508152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 380/751] 10.222.0.44 () {56 vars in 1129 bytes} [Fri Oct 28 09:33:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:46.513777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:46.585731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e1900-7427-41ed-8652-543efb13cfb1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:46.678435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:46.679195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:46.679541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:46.679901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:46.680767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:46.681084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:46.682602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:46.706433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8118b-c295-4e04-9ba0-1a6249da9de5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:46.726032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 372/752] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Oct 28 09:33:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:46.726927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:46.750426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:46.751160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:46.751513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:46.751861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:46.752675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:46.753086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:46.754679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:46.765494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 381/753] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Oct 28 09:33:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:46.766523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:46.872007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:46.936478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f48f1-e2a9-4224-a32c-3c0491e4e4b3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:46.939827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:46.956536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c0aa-82fa-4be6-abe9-a2f1ed342f94 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:47.006313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.007672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.008533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.009242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.018201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.019169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.019634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.020096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.030736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:47.043079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:47.045216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:47.047116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:47.056924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 373/754] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:47.058756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:47.148807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:47.151581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:47.222608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1194b69-3015-4189-abf4-7e77f45d1e2c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:47.259937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:47.267516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.268304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.268592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.268859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.269971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:47.270514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:47.272834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:47.279292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 374/755] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:47.280275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:47.340347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:47.352171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 382/756] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:33:47.352998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:47.493175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad024f6a-1f24-40f8-a7ad-ffef555447d7 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:47.538369 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38001a-0990-40f4-b858-310895c32d1b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:47.562110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.563486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.564222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.564946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.566467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:47.567326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:47.570020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:47.587649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 375/757] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:47.589608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:47.614119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.615779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.616512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.617175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.618984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] RBAC: Adding query filter params (interface=public, service_id=6ff754fbdc934b32b0bb7653be69e2d8, region_id=RegionOne) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:47.620456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:47.623647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:47.647439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 383/758] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/endpoints?service_id=6ff754fbdc934b32b0bb7653be69e2d8&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:47.647439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:47.684378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:47.774595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:47.801899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb0ec-1510-43f7-aa11-6c16769620ba None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:47.842208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aa3a2-6793-4a8d-9a4b-daa51824c27c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:47.869757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.871248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.872483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.873147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.894300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:47.897281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:47.913176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:47.914892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:47.915607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:47.916340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:47.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:47.927937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:47.930206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:47.930206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:47.930206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:47.936499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 376/759] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:47.943256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:47.956949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:47.960108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:47.995638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:47.997298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:47.998402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:47.998402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:47.998402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:47.999373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 384/760] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:48.001532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:48.073383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd828c-551a-452c-a755-7f3cf8cc62ad None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:48.114079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:48.115234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.115762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.116270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.117118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:48.118745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:48.132342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 377/761] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:48.133791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:48.139365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:48.156676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:48.220563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc9bfc-1e04-4824-aae1-bc8a44bbfaf3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:48.293368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:48.294502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.294992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.295473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.296788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:48.297312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:48.300198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:48.323949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44b32d-7208-4e05-b189-a8b06e15832a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:48.332990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 385/762] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:48.342901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:48.371903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:48.373342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.373864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.374345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.375356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:48.375919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:48.377658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:48.392933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 378/763] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:48.406129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:48.505741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:48.573349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922a0f-84cb-4e1d-ae63-ed65a25b7afd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:48.607382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a309dd-1920-478f-badb-cb43d6244e5c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:48.623396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:48.624060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.624456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.624736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.634399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:48.636544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-642c0d7b-56e0-497e-bfcc-ba673bb5e49f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:48.654387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:48.656194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 379/764] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:33:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa12ff-e40b-412b-b2a7-bab61b11c74d None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.661495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa12ff-e40b-412b-b2a7-bab61b11c74d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.665655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa12ff-e40b-412b-b2a7-bab61b11c74d None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.665655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 380/765] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:48.665655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa12ff-e40b-412b-b2a7-bab61b11c74d None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:48.674953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:48.683420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:48.684867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.685156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.685433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.695302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:48.696854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-af5dfd8f-672c-4c51-a59a-2ea640719163 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:48.710872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:48.713025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:48.714541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:48.718094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 386/766] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:48.719613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:48.719909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:48.720163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:48.741838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:48.743152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:48.854399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 387/767] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:48.856583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:48.925719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa12ff-e40b-412b-b2a7-bab61b11c74d None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:48.978617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:49.014719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.016544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.019591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.020879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.027170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:49.028125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:49.030953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:49.091998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 381/768] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:49.101237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:49.126380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39024a15-9689-4e4a-9ca2-a66de4af9a7b None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:49.194180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:49.232601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.233580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.233983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.234380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.235642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:49.236278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:49.239150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:49.262838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 388/769] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:49.264211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:49.295143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ad7a4-2042-46ed-89cd-1fbd274521ed None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:49.342145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.342920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.343287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.343625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.356426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:49.358178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:49.378846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:49.380990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:49.382720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:49.382720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:49.382720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:49.382720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 382/770] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:49.382720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:49.442112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7dac-681d-4f69-a44b-f18eb04c3991 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:49.442867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:49.490141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.491012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.491411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.492631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.510135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:49.517622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:49.519397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:49.521069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 389/771] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:49.524295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:49.545920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cc6de-90ca-4b28-be7e-a82cd4e6f8c9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:49.599755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:49.604775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.605790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.606370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.606819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.607908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=b3a1aa24c712441f98b56c9307c93a65) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:49.608441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:49.610780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd27710-ac04-4b71-b050-2fcd0f08f055 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:49.628265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 383/772] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:33:49 2022] GET /identity/v3/role_assignments?user.id=b3a1aa24c712441f98b56c9307c93a65&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:49.628265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144fed-63bb-4d17-964d-d5bed4c68470 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.628265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144fed-63bb-4d17-964d-d5bed4c68470 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.628265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144fed-63bb-4d17-964d-d5bed4c68470 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.628265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 384/773] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:49.628265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144fed-63bb-4d17-964d-d5bed4c68470 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:49.721806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa26c-8f6d-4bfa-b6e5-ebed6e026e08 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:49.789822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.790454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.790729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.790998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.791917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:49.792232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:49.794534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b953d-62fc-4e62-b941-ae3e6dd24e81 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:49.810370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 390/774] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:49.812017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.812391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.812637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.835139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:49.836467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:49.878525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:49.890209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144fed-63bb-4d17-964d-d5bed4c68470 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:49.963074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:49.964736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:49.965755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:49.965955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 391/775] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:49.966868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:49.968485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:49.969335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:49.972160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:49.972873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:49.991297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 385/776] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:50.002019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.023168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.119236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c507-4c8e-4b66-b20e-9ae45c6db069 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.174867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.175824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.176235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.176685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.204822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.206358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:50.228607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:50.229582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:50.230482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 392/777] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:50.250452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2f455-61d7-46b3-b70c-3e6359c3d4ac None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.253326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.363687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.363687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.363687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.363687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.365910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.378100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f64b-f2fc-40ac-ae76-fc222967f048 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.388216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.391336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:50.430215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:50.431956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:50.434075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:50.434075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:50.434075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:50.434075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 386/778] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:50.434447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.434447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.434447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.434846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.436283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:50.436283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.437660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.439944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.453290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 393/779] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:50.484991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.492680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:50.677586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f29ba-1edd-4879-b4de-11b3d1f0e0ea None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.704886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ff07e-c7e8-48e3-b8ba-69910eb74341 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:50.762968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.764087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.764628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.765079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.767052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:50.767639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.770781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.782757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:50.785270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:50.786136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:50.786904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/7b34a8c7d4f242c3a5be691db48cc0d5/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:50.796631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=7b34a8c7d4f242c3a5be691db48cc0d5, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:50.799429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:50.800184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 387/780] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:50.802090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.832536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 394/781] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:50 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/7b34a8c7d4f242c3a5be691db48cc0d5/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:50.834403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:50.867914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.019675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.060090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbe96a-3733-42d4-a335-66d51ea59015 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.086572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b456-8558-43dc-b9ed-29b31b110b60 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.131877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.132984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.133430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.133874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.149537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.152103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:51.178962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:51.180883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:51.185340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 395/782] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:51.187896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.187896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.187896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.190804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.191162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] PATH_INFO: `/v3/services/network` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.191569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.198596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:51.226547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:51.228849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:51.230587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:51.234118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 388/783] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:50 2022] GET /identity/v3/services/network => generated 88 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:51.245799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.373126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.488271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68baff6-8f3b-47f6-94cd-518d620adfb4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.554628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e276b0a-2968-4547-902f-7a5d72f80076 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.593835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.594489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.594778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.595051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.595826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:51.596138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.597665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.629692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.630529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.631066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.631527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.633846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] RBAC: Adding query filter params (name=network) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:51.634422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.637406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.641538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.646718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 396/784] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:51.649613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 389/785] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:51.653173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.660287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.821947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98847163-74de-4909-8916-77fce1a2c489 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.861812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.862442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.862725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.863000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.863646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] RBAC: Adding query filter params (type=network) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:51.863951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.865482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebe470-c52c-47ae-8d36-4629ac4b244b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.865927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41f99-1c68-46d1-b47b-2cb6df4077d3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:51.871574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 390/786] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:51.873340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a851-9e7e-4b32-bf5b-7260a5a7d685 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.873625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a851-9e7e-4b32-bf5b-7260a5a7d685 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.873903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a851-9e7e-4b32-bf5b-7260a5a7d685 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.880622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 391/787] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:51.883372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6a851-9e7e-4b32-bf5b-7260a5a7d685 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:51.909037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.926173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:51.927768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:51.928669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:51.929395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:51.952104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:51.955392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:51.974726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-fbbe422b-7084-4325-8686-5d259ca8d20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:51.993251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:51.995231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:51.997059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:51.997059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:51.997059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:52.000992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 397/788] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:52.004336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.005203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.005965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.021672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6a851-9e7e-4b32-bf5b-7260a5a7d685 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.036530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:52.038863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:52.063284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.063915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.064192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.064487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.065200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] RBAC: Adding query filter params (interface=public, service_id=7e5048a184fb43f4a43ee31ea8202668, region_id=RegionOne) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:52.065510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.066913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.076621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 392/789] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:33:51 2022] GET /identity/v3/endpoints?service_id=7e5048a184fb43f4a43ee31ea8202668&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.077526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.189225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 398/790] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:52.191451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.211542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ef43-3d3e-4809-b55a-07cea3cbc61b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.250014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.275984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.277136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.278516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.278884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.280028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:52.280601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.283210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.312684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 393/791] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.314851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.421134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44610b7-cd67-4297-abd9-df9a09bdf645 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.447502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.512749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ee823-d58e-407d-83e2-e0eeebecbf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.514177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ee823-d58e-407d-83e2-e0eeebecbf15 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.514888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ee823-d58e-407d-83e2-e0eeebecbf15 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.515553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ee823-d58e-407d-83e2-e0eeebecbf15 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.517541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ee823-d58e-407d-83e2-e0eeebecbf15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.520115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ee823-d58e-407d-83e2-e0eeebecbf15 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.538980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 399/792] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/services => generated 772 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:52.542092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca976f-6614-4907-8c18-7ee47f105dfb None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.542988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca976f-6614-4907-8c18-7ee47f105dfb None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.545047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca976f-6614-4907-8c18-7ee47f105dfb None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.548941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 400/793] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:52.559524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.560018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.565799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.594161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836e8b3-6c95-459a-abee-6ef2cda5e0c4 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.630573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:52.632641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:52.702037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:52.703258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:52.703731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:52.704212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:52.724587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:52.726538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:52.747824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:52.748838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:52.749726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:52.758387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 394/794] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:52.768828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.794655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 401/795] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:52.794655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:52.910606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:52.990492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37b754-a9a0-478c-a05b-d50a79774a90 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:52.993356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.034297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddc4ea-1105-4207-bdb6-5b49b4fbe58c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.035511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.036169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.036494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.036756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.037344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.038749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:53.049573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:53.051764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:53.053491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 402/796] 10.222.0.44 () {56 vars in 1129 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:53.061454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.116842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.118229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.118944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.119609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.124720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.125606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.128727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.162622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 395/797] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:53.175370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.244994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3b259-3125-4cda-a853-ddfd52a3be14 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.286642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.287268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.287562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.287810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.288504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.288812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.290280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.296631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 403/798] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:53.297622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.339065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.385635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18318f5d-4b20-4358-8249-85d2dd99e58d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.405091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.430373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fea822-29c9-4b34-be95-5305902d4bb5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.440233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.441018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.441313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.441598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/3666250d3b11459e84b2e3b672f9ba3c/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.443871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=3666250d3b11459e84b2e3b672f9ba3c, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.445397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.464680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 396/799] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:53 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/3666250d3b11459e84b2e3b672f9ba3c/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:33:53.466345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.496340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.497117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.497400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.497771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.549482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:53.558852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:53.560509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:33:53.561388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:53.571006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 404/800] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:53.590091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.617752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a3a8-5283-4376-abdd-290fb84f26ae None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.665379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.666096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.666650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.667250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.667935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.669102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.671065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.677520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 397/801] 10.222.0.44 () {56 vars in 1124 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:53.683381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.726835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.813127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:53.830233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0562-e820-483c-a00a-7bcc472a01bd None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.838960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0ee59-46c8-4106-bd51-2701d4ca9eac None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:53.886266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.887860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:53.888118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.888536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:53.888764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.889013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:53.889326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.889434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:53.890259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:53.890457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.890756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:53.892275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.892421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:53.910260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 405/802] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:53.921374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:53.944781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 398/803] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:33:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:54.085320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fe376-7c99-40ff-ad5c-adea44b0fe5b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:54.157230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:54.158431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.158973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.159513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.175649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:54.177356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8689ee83-7631-4b38-9fd3-5ad9d925c52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:54.201267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:54.202277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:54.203168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:54.203168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:54.203168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:54.206617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 406/804] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:54.209648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:54.426015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:54.455226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857f11-2e7e-4b18-bcd3-367e0f2689fd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:54.517035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54938ac8-35d3-46b4-8af5-dbf2b81cefae None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.517035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54938ac8-35d3-46b4-8af5-dbf2b81cefae None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.517035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54938ac8-35d3-46b4-8af5-dbf2b81cefae None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.518643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 407/805] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:54.525160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.525444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.525711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.535242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:54.535870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:54.536784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.537226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.537721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.539770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:54.539770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:54.543031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:54.556687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:54.558293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:54.570436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 399/806] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:54.576773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:54.719270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 408/807] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:54.771862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6b52-b45b-4b8f-bbad-cfec9b79ca3e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:54.814321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:54.815362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:54.815853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:54.816413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:54.829784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:54.831377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:54.845648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:54.846663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:54.847901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 400/808] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:54.854559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.037057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528014b-2800-4163-990d-736d5e1a0693 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.084331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.090222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.090900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.091138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.091321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.092097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:55.095168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.096892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.125958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 409/809] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Oct 28 09:33:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:55.131972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.146796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.288662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a131daf-c29b-45e6-8b68-783aaa33c644 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.332906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.376938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.377911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.378336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.378748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.435024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.440287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:55.480025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:55.482541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:55.484073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:55.484073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:55.484073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:55.484073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 401/810] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:55.487667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.592702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d205-7447-425c-a1c0-0c7d17a2da74 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.618665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.672375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.673035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.673310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.673577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.688699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:55.696293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:55.698137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:55.700360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 410/811] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:55.709426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad939b-eb05-4892-90ce-d2953700428e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:55.710893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.790704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:55.791403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:55.791690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:55.792221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:55.792909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:55.793879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:55.796522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:55.815022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 402/812] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:55.820963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:55.821548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:55.979906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560620c-e020-45b1-8e1d-e5abcf3f8cb7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.056714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d158-47d0-41ed-b6af-c43c98bbeded None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.103519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:56.133451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.134498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.134986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.135481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.136653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.137722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:56.137722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:56.139971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:56.140144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.140979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.141744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.157697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:56.160631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:56.171307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 411/813] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:56.177476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:33:56.367508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:56.369329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:33:56.370794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:56.375505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 403/814] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 554 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:56.381399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:56.474455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3760eb-46db-44ec-a607-87b9061c9d6a None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.517080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:56.583884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.585701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.586503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.587230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.591835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354f35-3247-4702-b7e0-4ba97ca6911b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.611870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:56.615318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:56.632884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.633414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.633694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.633960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.634681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:56.634981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:56.636529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0709-929f-4d62-b2a2-7480ec6ad7ca None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:56.650492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:56.652356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:56.654249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:56.654249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:56.654249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:56.656729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 404/815] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:33:56.658236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcbc85-4b1c-43e1-aaad-9f103fd393f1 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.658513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcbc85-4b1c-43e1-aaad-9f103fd393f1 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.658775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcbc85-4b1c-43e1-aaad-9f103fd393f1 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.659060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 412/816] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:56.660451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 405/817] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:56.665875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcbc85-4b1c-43e1-aaad-9f103fd393f1 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:56.666857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:56.716764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:56.787635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcbc85-4b1c-43e1-aaad-9f103fd393f1 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.828594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.829230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.829538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.829818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.830444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:56.830752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:56.832202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbd877-8c86-4850-8b57-6e0f548b9b2c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:56.846355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 406/818] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:56.847711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.847985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.848287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:56.867746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:56.869024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:56.898482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91190a-5c76-4301-a8ba-5d3d98e00a96 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:56.956543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 407/819] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:56.957590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:56.986358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d26490-a08c-4455-a440-e8a638c6906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:56.990776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d26490-a08c-4455-a440-e8a638c6906b None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:56.991738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d26490-a08c-4455-a440-e8a638c6906b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:56.992993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d26490-a08c-4455-a440-e8a638c6906b None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/b3a1aa24c712441f98b56c9307c93a65/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.043943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d26490-a08c-4455-a440-e8a638c6906b None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=b3a1aa24c712441f98b56c9307c93a65, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.045209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.049634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d26490-a08c-4455-a440-e8a638c6906b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.073789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 413/820] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:33:56 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/b3a1aa24c712441f98b56c9307c93a65/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:33:57.076543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e995b3-143c-4e7c-b375-01e77a1e6ea3 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.076898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e995b3-143c-4e7c-b375-01e77a1e6ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.077332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e995b3-143c-4e7c-b375-01e77a1e6ea3 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.083939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 414/821] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:57.085984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.086280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.086674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.109816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:57.111161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:57.123682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.204511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 415/822] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:57.206873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696530-4f30-4f48-9ab7-192d3484bfa3 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.284896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.286542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.287403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.288233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.304905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.308210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:33:57.334475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:57.336454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:33:57.338483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:57.343586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 408/823] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:33:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:57.353455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.412072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.565954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eb2e2-ade4-4cd7-a8f6-4808a4ba26ed None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.624280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.624280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.624280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.624280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.625007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:57.625007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.625007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484ede-3961-441d-9c24-b3a9d0f6be38 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.635977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.661517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 416/824] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:57.661802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026dee7-5188-4900-a711-1146af8113b9 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.663492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcce2d-3608-40d8-b278-434b0d858d47 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.663986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcce2d-3608-40d8-b278-434b0d858d47 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.664510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcce2d-3608-40d8-b278-434b0d858d47 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.667887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 417/825] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:33:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:33:57.669402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcce2d-3608-40d8-b278-434b0d858d47 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.685331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:57.714634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.715874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.716163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.716493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] PATH_INFO: `/v3/services/network` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.717151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:57.718932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-69d09fb9-7212-450f-81f1-b84d349e9205 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:57.731479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:57.733844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:57.735768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 409/826] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/services/network => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:33:57.737946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.737946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.737946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:57.757666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:33:57.758907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:33:57.860312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 410/827] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:33:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:33:57.860652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:57.872593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcce2d-3608-40d8-b278-434b0d858d47 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:57.923235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:57.924365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:57.924902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:57.925381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.041531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.045284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.048366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.061612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.085994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a557-5925-441b-82e1-7ca1f0365e1e None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.150966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.151877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.152367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.152990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.181062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:33:58.190994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:58.192202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:58.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 411/828] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:58.194970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.265044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 418/829] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:33:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:33:58.266734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.373251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24e601-c0b3-4b48-b2d1-1b2e768a85f2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.429170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.430080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.430573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.431051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.432726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] RBAC: Adding query filter params (name=network) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:58.433073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.436854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.444448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 412/830] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.446250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.453837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeb434-08b9-4f0f-8d9f-e5f529e8c822 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.456811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.467938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.502426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.503071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.503352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.503627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.504212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.505652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:58.522875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:58.524067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:58.525120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 419/831] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:58.526819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.591311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cc9e6-e154-44cd-9c62-6166a05b8e94 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.633659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.634306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.634590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.634863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.635770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:58.636080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.639057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.654701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 413/832] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.656693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.685500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de4434-2f4f-4f94-8e56-fb455604a270 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.725144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.725802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.726080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.726350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.743147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.744680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:58.763846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:58.773345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:58.774945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:58.774945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:58.774945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:33:58.774945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 420/833] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:58.774945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.790319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.801280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:58.859836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50165-b78d-49f3-a944-b25a038622bd None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:58.928043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:58.929365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:58.929914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:58.930598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:58.932002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] RBAC: Adding query filter params (type=network) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:58.932761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:58.936394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:58.950421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 414/834] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:58.950421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:58.958321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322da60-28b3-47b6-ae52-8584f9503b44 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.025901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.026685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.027189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.028359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.029576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:59.030591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.032743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.046563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 421/835] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.046563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.157437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001da5-de18-4528-a22a-4c319361cebf None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.201574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.225766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77bfc-f69f-4a0c-94fa-a02c8e889860 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.230198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.231643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.232416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.232904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.236901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.260041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.265616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.273750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.275436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.275436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.275877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.277016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:59.277504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.280911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:33:59.285994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:33:59.287021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:33:59.287903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:33:59.287903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:33:59.287903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:33:59.289409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 415/836] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:33:59.290572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.304782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 422/837] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.306273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.453270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fc9e0-4f26-459d-beff-fca487b0b4df None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.493392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568bf49-f413-4f4c-b353-9f77f0652c32 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.524111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.525865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.526331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.526781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.528604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.531022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.552753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.553788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.554171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.554653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.555785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:59.556267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.558741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.565846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 416/838] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:33:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:33:59.567715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.575788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 423/839] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:33:59.575788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:33:59.610654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.758786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:33:59.878602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85697db-0024-4071-a4ac-57e25c20cfa8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.905614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1968a01-aad0-464c-b0e6-94ada37b2133 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:33:59.965784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.967400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.967963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.968519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.982601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.985085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:33:59.987584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:33:59.988746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:33:59.989230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:33:59.989706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:33:59.990787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:33:59.991337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:33:59.993990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219be59-74ef-47d1-9abb-9f067d87db66 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-dd2afbf6-22af-4436-8a63-33e07ac485a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:00.007281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:00.009258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:00.011034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 424/840] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:00.014448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c223-8ac9-45e0-8ef4-7ce3c11d96ff None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.014448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c223-8ac9-45e0-8ef4-7ce3c11d96ff None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.014448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c223-8ac9-45e0-8ef4-7ce3c11d96ff None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.020331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 425/841] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:00.021149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c223-8ac9-45e0-8ef4-7ce3c11d96ff None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.029156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 417/842] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.030811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.031299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.031802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.065020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:00.067192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:00.140838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.196537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c223-8ac9-45e0-8ef4-7ce3c11d96ff None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.202977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 418/843] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:00.203976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.267473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.292012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.295078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.296457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.296457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.297243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:00.297721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.301495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.330180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 426/844] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.341521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.455358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fde8-2954-496b-abcc-19b7f5c365c4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.525985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.527374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.528699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.529513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.544319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.548069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:00.570628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:00.572199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:34:00.574421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:00.577231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234237-5985-48a0-9321-1c5af4770992 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.578455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 419/845] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:00.587535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.619450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.632132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.632688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.633021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.633308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.634141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=862360b634994703825014c6d7c129f0, user.id=7b34a8c7d4f242c3a5be691db48cc0d5) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:00.634567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.636183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.644212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 427/846] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/role_assignments?user.id=7b34a8c7d4f242c3a5be691db48cc0d5&scope.project.id=862360b634994703825014c6d7c129f0&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:00.644989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.751236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:00.766595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b7da-daa2-4635-a34c-56ba0f5912e8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.822221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.823003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.823419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.823753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.824766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:00.825149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:00.826750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:00.856962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 420/847] 10.222.0.44 () {56 vars in 1135 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:00.865916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:00.877757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8185f2-d96f-4bd6-8b3a-ac2b2f829a12 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:00.929698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:00.930398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:00.930681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:00.930957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:00.947955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:00.958807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:00.959855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:34:00.960861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:00.961532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 428/848] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:00.970559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.064693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.070356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdae2-0228-4d40-92f9-67575ab98cb8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.130609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b1c8-a696-4f2d-92e1-346e8355a486 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.136223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.138529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.139155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.139766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.170679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.178881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.179815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.180194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.180509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.181227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:01.181533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.183050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.200383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 429/849] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:01.204056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.270749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.272938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.400364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f40c-cecb-4a86-9d65-f6d0a7b9aa5c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.420098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 421/850] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:34:01.433487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.436258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.482815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.483254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.483694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.484170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.492801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.508161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.510852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:01.540069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:01.541394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:01.542542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:01.542542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:01.542542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:01.547970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 430/851] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:01.550283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.581962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b072-d22c-4dd2-80f7-5b5b563aec95 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.648497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.649266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.649553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.649825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.663835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.665983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:01.686487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:01.688871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:01.691852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:01.691852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:01.691852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:01.691852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 422/852] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:01.696749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.781947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38e039-172e-48e8-93bf-98cc5c464cea None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.831883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.832578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.832857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.833131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.833805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:01.834110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.835591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.855673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 431/853] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:01.868459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:01.901128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.904229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:01.915127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080cde-c231-4c24-bd4b-c3a778c44456 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:01.985702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:01.987223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:01.988009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:01.988816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:01.990247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:01.991079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:01.993947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:01.994847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6a827-96db-422e-a52e-cee8e469b44d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.019493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 423/854] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:02.029673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.039088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.039807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.040096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.040401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.051204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.052771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:02.067259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:02.069497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:02.071462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 432/855] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:34:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:02.074866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.182897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.204546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a2e2e-31ff-441f-92b5-3e0dd5fe0b8c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.245321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.245596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e75f0-eec6-4854-bd11-8fb6a66fa528 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.245954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.246233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.247051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.247871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:02.248166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.249858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bdc9e-1c0c-4ec9-b0e7-8435f87e22da None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.275052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 433/856] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:02.275052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568f03-5d1e-443a-94b1-0b46e51db3f9 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.275052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568f03-5d1e-443a-94b1-0b46e51db3f9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.275052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568f03-5d1e-443a-94b1-0b46e51db3f9 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.275052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 434/857] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:02.277256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568f03-5d1e-443a-94b1-0b46e51db3f9 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.316660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.317723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.318345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.318830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.331754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.334459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-799c8221-089c-4663-84ca-ee9b99ccb6fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:02.356493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:02.357728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:02.358593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:02.365857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 424/858] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:02.368288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.368778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.369254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.399040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:02.400492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:02.402416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568f03-5d1e-443a-94b1-0b46e51db3f9 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.421134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.453181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.453714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.453989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.454259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.468812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.517908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 425/859] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:02.519417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.571005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.574027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.749272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ca281-8a38-4a89-845d-786a4f3a18ed None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:02.795091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 435/860] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:34:02.808283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.819363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:02.820113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:02.820481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:02.820846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:02.821649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:02.822020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:02.823589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:02.839589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 426/861] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:02.849258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:02.864543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.890259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:02.995239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d581f-b5a9-410d-a1c5-670772442226 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.054667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf380c-67a0-4062-9a66-1d4d609b4d57 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.070633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.071846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.072327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.072765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.090838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.092752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.102687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.103689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.104069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.104487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.105570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=862360b634994703825014c6d7c129f0, user.id=3666250d3b11459e84b2e3b672f9ba3c) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:03.106081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.108219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:03.110301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:03.112140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:03.114576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:03.114576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:03.114576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:03.116872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 436/862] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:03.117143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:03.132454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 427/863] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:02 2022] GET /identity/v3/role_assignments?user.id=3666250d3b11459e84b2e3b672f9ba3c&scope.project.id=862360b634994703825014c6d7c129f0&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:03.132454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:03.274527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:03.279459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:03.296747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b59de-23cd-41b9-94d6-5b855f68a7e0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.341884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba875f0-8099-44dc-b06e-949da357d940 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.372223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.374012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.374733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.375412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.376937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.379843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.409043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.410195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.410642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.411044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.412047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:03.412534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.414735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.419700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 437/864] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:03 2022] POST /identity/v3/services => generated 251 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:03.440372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 428/865] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:03.446186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:03.619472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec781f2-bfda-4f81-b33c-476338dd8e1b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.669764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.670863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.671353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.671850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.680358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.682305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-00808cdd-c1b2-4dd6-9d9b-23b565f3e46a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:03.697021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:03.697988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:03.698855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:03.701929 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 438/866] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:03.708798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:03.756875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913c0f-11df-4029-bf0a-bd6c9973bc42 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.757228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913c0f-11df-4029-bf0a-bd6c9973bc42 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.757441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913c0f-11df-4029-bf0a-bd6c9973bc42 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.759159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 439/867] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:03.765656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.766082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.766464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.787145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:03.788593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:03.793181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:03.878193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 440/868] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:03.913367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41200ea1-22ac-4d94-a4a6-975be1a11d91 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:03.975355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:03.985865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:03.986886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:03.987358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:03.987826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:03.989114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:03.989649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:03.992193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:04.018089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 429/869] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:04.024407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.149390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebafbd4-2be8-4af4-885d-627b8a01dad0 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:04.191880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:04.192904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:04.193384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:04.193883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:04.194840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=b3a1aa24c712441f98b56c9307c93a65) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:04.195356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:04.197132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:04.205449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 441/870] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/role_assignments?user.id=b3a1aa24c712441f98b56c9307c93a65&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:04.271041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.483752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fff69-8a1d-431b-aa8d-0a1c75d8233c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:04.542676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:04.543544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:04.544837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:04.544837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:04.545488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:04.547108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:04.564672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:04.566554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:04.569965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 430/871] 10.222.0.44 () {56 vars in 1132 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:04.578087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.584505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:04.774880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa88a-642c-48d5-a4f7-0104c314b034 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:04.846561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:04.848020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:04.848811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:04.849516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:04.851152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:04.851928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:04.854945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102039e4-b21a-466e-b954-95d655810a6e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:04.866651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 442/872] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:04.873480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:04.949390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:05.036644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062157e-333b-4aa8-8fe4-e60a67072fc3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:05.093538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:05.094183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:05.094464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:05.094744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:05.095406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:05.095719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:05.097211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c70f90-4801-4a11-bc7a-34059edf2e59 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:05.102956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 431/873] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:06.110627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ec84b-23a0-4ed2-9eb8-d19eb69e26d3 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.111500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ec84b-23a0-4ed2-9eb8-d19eb69e26d3 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.111500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ec84b-23a0-4ed2-9eb8-d19eb69e26d3 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.112899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 443/874] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:06.119024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.119728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.119728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.140420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.141653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.242519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 432/875] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:06.522315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ec84b-23a0-4ed2-9eb8-d19eb69e26d3 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.607745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:06.678681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ec84b-23a0-4ed2-9eb8-d19eb69e26d3 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:06.749682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:06.751295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.752078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.752869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.754272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:06.757303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-3d9f95e2-ea7f-4f89-9df8-21f50eac0c83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:06.776308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:06.779003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:34:06.780741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:06.786518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 444/876] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:06.796474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:06.820389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fce7b3-ecff-42b0-b9f2-fdea5f13bf91 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.820888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fce7b3-ecff-42b0-b9f2-fdea5f13bf91 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.821126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fce7b3-ecff-42b0-b9f2-fdea5f13bf91 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.822583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 445/877] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:06.829023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:06.829437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:06.829708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:06.850686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:06.852000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:06.903158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:06.940060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 446/878] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:07.007405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab2851-6683-47b7-b319-a650fbe3916c None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.079284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.080344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.080828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.081319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.082517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:07.083066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.085751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.096220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 433/879] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.104816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.177636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.224117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8fd37-d2cd-4109-8086-bee6681cb261 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.269760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.270501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.270783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.271057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.271743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:07.272048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.274428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.280708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 447/880] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.289693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.314964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.470825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bffadf-9c06-4181-b395-0c39371104b8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.507034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e8e95-99d5-40dd-989a-a95f2f62d742 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.507246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.518821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.519640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.520073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.520659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.521373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.523024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:07.534927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:07.536170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:07.537133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:07.538014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.540877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 448/881] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:07.545792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.577630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.579627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.580128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.580857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.583103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] RBAC: Adding query filter params (interface=public, service_id=91de6bdc1e90495ca846d9c3af560098, region_id=RegionOne) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:07.583674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.587540 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.607246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 434/882] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/endpoints?service_id=91de6bdc1e90495ca846d9c3af560098&interface=public®ion_id=RegionOne => generated 194 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.609025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.685632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941417bc-f777-4ed6-86f9-e03d0ad96da8 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.729829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.730452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.730729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.731620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.733571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:07.734112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.736803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.746150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 449/883] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.754259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:07.799889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f354-6fce-464a-b740-f6244e08f608 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.861315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:07.862260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15de330-f11d-4d1a-9dfa-996760403e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.863083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de330-f11d-4d1a-9dfa-996760403e59 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.863665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de330-f11d-4d1a-9dfa-996760403e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.864285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de330-f11d-4d1a-9dfa-996760403e59 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.865605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15de330-f11d-4d1a-9dfa-996760403e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.867862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15de330-f11d-4d1a-9dfa-996760403e59 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.885537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 435/884] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/services => generated 1011 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:34:07.927651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e0d5-9b7f-42dd-8816-0e91482e6a15 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:07.974943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:07.975272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64cae-1487-4441-ae9e-a2d39bba4c97 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.975909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64cae-1487-4441-ae9e-a2d39bba4c97 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.976095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.976346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.976563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.977236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:07.977539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:07.979050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379ef2-7356-487f-a9aa-b784936e7f04 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:07.980929 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc64cae-1487-4441-ae9e-a2d39bba4c97 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:07.984413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 436/885] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:07.986625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 450/886] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:07.992284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:07.992284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:07.992284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.013795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:08.015291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:08.030800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec9b8-2369-4b27-82f8-75745b85709c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.031522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec9b8-2369-4b27-82f8-75745b85709c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.032029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec9b8-2369-4b27-82f8-75745b85709c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.034262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 451/887] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:08.044031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.045370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.045862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.068115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:08.069874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:08.085696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.155351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 437/888] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:08.214658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 452/889] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:08.456054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.502908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.566118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.611084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1fa7-415e-4b30-a3c5-faafaf3a0d22 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.627106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389304-9586-48ab-9430-ab2356772e2d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.670646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.671643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.671814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.671951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.672426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.672655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.672942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.673222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.674178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.675806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.686767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:08.692784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:08.694228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:08.695213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:08.695888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 438/890] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:08 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:08.703053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 453/891] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:08.704213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:08.744865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:08.844751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed175dc-ad86-40fc-93b8-023f5312d5dc None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:08.888636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:08.889239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:08.889526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:08.889804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:08.890522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:08.890837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:08.892347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:08.905232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 439/892] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:08.911721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.038465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eda804-b219-4044-af26-487c511e2dec None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.060739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.082039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.082805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.083095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.083375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.096148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.097704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:09.115515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:09.116617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:09.117524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:09.117524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:09.117524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:09.117524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 454/893] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:09.123095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.238039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.250080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64c8ad-c338-47a5-84f7-06108fa0b35c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.291709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.292377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.292912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.293185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.294648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:09.294962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.296406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.311037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 440/894] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:09.316587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.442895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f45f04-8d11-45af-92a9-ab643f2bc728 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.482806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.483461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.483745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.484022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.493163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.494568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:09.508411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:09.509465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:09.510414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 455/895] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:09.516201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.639397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376dea6-0501-44c5-8d38-38895d661539 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.679535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.680582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.681095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.681601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:09.682590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:09.683122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:09.684949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:09.706391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 441/896] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:09.712280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:09.737941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:09.858414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa56cc-d93f-49bc-9f42-b91f6885edfc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:09.931789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:09.932836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:09.933308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:09.933834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.099811 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:10.102328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:10.147146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:10.315757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 456/897] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:34:10.321129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:10.334163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:10.507444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548faf54-e9d9-4b54-9d67-15c2386b77ed None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:10.573030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:10.574780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.575400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.575990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.589146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:10.591705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:10.617942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:10.619868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:10.620997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:10.620997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:10.620997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:10.623866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 442/898] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:10.633120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:10.773137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999e30-4439-4ccc-80c8-0963feefdb5b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:10.799249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:10.827571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:10.828637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:10.829093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:10.829527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:10.830717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:10.831261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:10.833973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8f9b2-fcb1-4bd2-b3cf-af1241520e5c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:10.859116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 457/899] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:10.867995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:10.975636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.024634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719edbb-a9ba-4e15-8ddb-8eee1b75ab52 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.063921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.064675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.065018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.065300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.073405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.074970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:11.087953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:11.089822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:11.093022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 443/900] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:11.097668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2d64-afaa-4fdf-b6d3-1d7544dc9389 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.098723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2d64-afaa-4fdf-b6d3-1d7544dc9389 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.099576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac2d64-afaa-4fdf-b6d3-1d7544dc9389 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.101191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.103417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 458/901] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:11.110875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0510-85e2-461f-9821-98fb6765421e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.111806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0510-85e2-461f-9821-98fb6765421e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.112689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0510-85e2-461f-9821-98fb6765421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.147967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e71c0510-85e2-461f-9821-98fb6765421e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:11.150753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e71c0510-85e2-461f-9821-98fb6765421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:11.229858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902f1a-1473-49ad-b7a2-1bdef6c3d49f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.259441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.282366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.282893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.283176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.283452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.284171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:11.284550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.286104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.310405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 444/902] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:11.311415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.327251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 459/903] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:11.387578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070826c-ad3a-49fb-949d-6287d5bd7f53 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.387849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070826c-ad3a-49fb-949d-6287d5bd7f53 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.388880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070826c-ad3a-49fb-949d-6287d5bd7f53 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.394892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 460/904] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:11.396954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adf7a7-a059-44ff-b633-7cc78f64d347 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.397449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adf7a7-a059-44ff-b633-7cc78f64d347 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.397589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adf7a7-a059-44ff-b633-7cc78f64d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.418176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b2adf7a7-a059-44ff-b633-7cc78f64d347 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:11.420282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b2adf7a7-a059-44ff-b633-7cc78f64d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:11.444277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f670d3-3c75-48f6-bc11-bf6c81093c3d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:11.492132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:11.492806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.493213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.493496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.494268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] RBAC: Adding query filter params (role.id=7da0a465d7bc4b67bffb4e4a807e77f4, scope.project.id=862360b634994703825014c6d7c129f0, user.id=b3a1aa24c712441f98b56c9307c93a65) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:11.494586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:11.496081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dd30a-144a-4ab5-b868-13691eb47b79 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:11.508376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 445/905] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/role_assignments?user.id=b3a1aa24c712441f98b56c9307c93a65&scope.project.id=862360b634994703825014c6d7c129f0&role.id=7da0a465d7bc4b67bffb4e4a807e77f4 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:11.529003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 461/906] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:11.667994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd18e-4a28-4516-9e5e-f60bee289709 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.669297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd18e-4a28-4516-9e5e-f60bee289709 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.669297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd18e-4a28-4516-9e5e-f60bee289709 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.670887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 446/907] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:11.681624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:11.682665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:11.682665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:11.724195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:11.726107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:11.816982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:11.851113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd18e-4a28-4516-9e5e-f60bee289709 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:11.876745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 462/908] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:11.877641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.000915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af7ee6-5e12-4019-94f8-809b82d62783 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.036772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.043190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.045473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.046393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.046393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.046583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.047998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:12.058341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:12.059950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:34:12.060845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:12.065694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 463/909] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:12.067187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.136838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.209729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd18e-4a28-4516-9e5e-f60bee289709 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.273957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.274948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.275468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.276032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.277650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.278286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c086c-9291-4015-871f-6d6a3df9e628 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.281374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.332415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 447/910] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:11 2022] POST /identity/v3/services => generated 241 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:12.359668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.399920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.401742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.402713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.403653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.405471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:12.406504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.409035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.421842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 464/911] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:12.428088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.573253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb110-5c1a-42b9-9acf-2dc5b6541b60 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.578876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.582466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:12.597668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29190-100a-4a0a-9bd9-74a388485a19 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.633727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.634409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.634676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.634951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.635564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.637214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.641536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.642570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.643006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.643428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.644229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:12.644752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.646321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:12.647962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:12.649690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:12.650573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 448/912] 10.222.0.44 () {56 vars in 1132 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:12.659066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 465/913] 10.222.0.44 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:12.661652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.667078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.824923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c863bd-0e02-4160-b4c2-864c2a30b7a3 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.825610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4919-b2e4-4116-acab-c73ceb0653af None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:12.867987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.868747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.869106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.869653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.870648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.872567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.873634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:12.874475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:12.874754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:12.875033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:12.875703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:12.876011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:12.877481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:12.889960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 449/914] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:12.892834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:12.908507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 466/915] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:34:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:12.948681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:13.054816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0083703-a33c-49fb-9b7b-2b9aae6a093e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.117034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.118973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.118973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.118973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.119638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:13.119949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:13.121503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:13.132385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 450/916] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:13.136229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.162356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:13.291310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9109-e2ea-4939-9e8a-a6f9a998b90d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.358181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.362161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.362161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.362161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.362161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] RBAC: Adding query filter params (interface=public, service_id=6f10d806f0ae48a097913eaa6b51ec2c, region_id=RegionOne) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:13.362161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:13.364817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056804-0e14-400b-8b23-f0a79f64ff20 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:13.374933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 467/917] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/endpoints?service_id=6f10d806f0ae48a097913eaa6b51ec2c&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:13.384556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:13.520482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:13.533722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77dda2-9465-4974-9c7c-924d1289e0fc None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:13.580949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65cb19-1d8f-4715-93be-a181aebec328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:13.582255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65cb19-1d8f-4715-93be-a181aebec328 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:13.582930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65cb19-1d8f-4715-93be-a181aebec328 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:13.583417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65cb19-1d8f-4715-93be-a181aebec328 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:13.584435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65cb19-1d8f-4715-93be-a181aebec328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:13.586078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65cb19-1d8f-4715-93be-a181aebec328 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:13.594589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 451/918] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:34:13 2022] GET /identity/v3/services => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:34:14.710580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478727f-5fd8-4945-b763-942ef733be6f None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.711407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478727f-5fd8-4945-b763-942ef733be6f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.711407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478727f-5fd8-4945-b763-942ef733be6f None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.714285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 468/919] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:14.720365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.721141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.721141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.742379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:14.743778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:14.831870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456c8d8-f3d1-4624-b642-455ed43f308a None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.832158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456c8d8-f3d1-4624-b642-455ed43f308a None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.832648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456c8d8-f3d1-4624-b642-455ed43f308a None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.834444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 469/920] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:14.840890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:14.841473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:14.841813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:14.864224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:14.866519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:14.874111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 452/921] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:15.001878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 470/922] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:15.151465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.247883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.266104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f247-f3e6-4021-8a73-3bd16e060b9e None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.308009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.308707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.309023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.309371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.321058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.325784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:15.331153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:15.332157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:15.333023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:15.337493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 453/923] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:15.338862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.341317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.473255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4380d4-b21d-4d2e-99eb-4d2dd26efbbe None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.490377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff982a-6eca-488a-90ee-2ae1e2f8c13d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.515059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.515854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.516305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.516596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.518043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:15.518438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.520400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.532816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 454/924] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:15.535132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.535796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.536077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.536386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.537024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.538522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.539330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:15.552297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:15.553368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:15.554207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 471/925] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:15.556373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.566640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.676456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.692650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3262-7972-4c88-b311-b9734ba5b0e8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.725453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6904-08c2-49ee-8d21-a018e349a686 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:15.748529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.749575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.750034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.750478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.772144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.774860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.787397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:15.788155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.788731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.789199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.790288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:15.790808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:15.793307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab1851-c1ed-48e8-a424-3ea5285660e7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:15.801936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 472/926] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:15.804020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89a03-e2ca-4f74-a6e5-7223b9ffb767 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.804525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89a03-e2ca-4f74-a6e5-7223b9ffb767 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.804993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89a03-e2ca-4f74-a6e5-7223b9ffb767 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:15.806170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:15.807980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:15.810984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:15.810984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:15.810984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:15.810984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 455/927] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:15.811464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:15.813375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 473/928] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:15.817494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:15.817956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:15.818402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:15.850169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:15.852821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:15.903422 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:15.961986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ca9f9-3ffb-4328-be96-109a5f651e7a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.004477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 474/929] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:16.006533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.012683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.012683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.012683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.012683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.013373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:16.013373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.015678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.032978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 456/930] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:16.035264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.167181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.221877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276fb1f-49c0-452c-ad4f-8d568b936d7a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.254040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20631fc-3d22-4bb9-83ad-10ccf1b264a1 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.258019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.288169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.290644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.291654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.292335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.295135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] RBAC: Adding query filter params (interface=public, service_id=8bff38b865db4d989b7cd367388427b6, region_id=RegionOne) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:16.296847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.300373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.301389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.302122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.302501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.302895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.303669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:16.304069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.305590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.314151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 457/931] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/endpoints?service_id=8bff38b865db4d989b7cd367388427b6&interface=public®ion_id=RegionOne => generated 194 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:16.321457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.331927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 475/932] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:16.333448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.504055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e422d-708d-46fb-a3f4-e8aa70bc2404 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.524708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076deda-dbfc-46b1-acc7-ffe3c4c2376f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.561743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.563048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.563770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.564519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.565499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.567937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.574528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.580965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 458/933] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/services => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:34:16.582324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.597048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.598672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.599485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.600176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.622609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.626833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:16.659499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:16.661489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:16.664470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:16.669935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 476/934] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:16.677386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:16.713956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:16.813558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dcd4-c368-4987-8ab3-c105a755cd96 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.873113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33907-09cb-4e54-beff-d9d7b6c86e3c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:16.885754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.886763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.888459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.888967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.890126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.895375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.897772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING keystone.server.flask.common [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 09:34:16.938327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.sql.core [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:34:16.938327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 09:34:16.938327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [parameters: {'id': '51cbd728c294469293926bbbc2382ec1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 09:34:16.938327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88074) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:34:16.954027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:16.955706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.956636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.957334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.958921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:16.959805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:16.963035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0969cc-fea1-4638-8cd5-d6ca90ad1610 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-8735ad33-9839-4b1c-b97a-246bc75e9bb0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51cbd728c294469293926bbbc2382ec1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51cbd728c294469293926bbbc2382ec1. Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:34:16.970057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result.read() Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 09:34:16.971799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application yield resource Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise self.value Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application session.commit() Oct 28 09:34:16.974101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:34:16.977109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:34:16.980792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result.read() Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:34:16.982412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [parameters: {'id': '51cbd728c294469293926bbbc2382ec1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:16.984399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:16.988212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51cbd728c294469293926bbbc2382ec1. Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 459/935] 10.222.0.44 () {60 vars in 1140 bytes} [Fri Oct 28 09:34:16 2022] POST /identity/v3/projects => generated 262 bytes in 395 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1dfa3-b6bf-4c90-956e-71aebe87d1b4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:16.990460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1dfa3-b6bf-4c90-956e-71aebe87d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:16.992095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1dfa3-b6bf-4c90-956e-71aebe87d1b4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:16.992095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 460/936] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:16.992095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1dfa3-b6bf-4c90-956e-71aebe87d1b4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.003655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 477/937] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:17.007029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.007499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.007917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.041319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:17.043662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:17.121164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:17.135314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1dfa3-b6bf-4c90-956e-71aebe87d1b4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.147649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:17.176419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 478/938] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:17.176419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.213706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.215728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.217346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.218653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.235497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:17.240733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:17.262417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:17.264315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:17.266252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 461/939] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:17.273023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.386376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0afb3c-c76b-4cb1-b411-4d4ce2d9a977 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.469846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.471233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.471699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.472138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.502257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8ef34-ab78-4554-abb3-eb9afa7f8e41 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.502715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:17.505111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:17.537947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:17.540157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:17.542378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:17.542378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:17.542378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:17.542378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 479/940] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:17.553235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.580983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.581927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.582201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.582475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.583154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:17.583460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:17.585330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:17.609418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 462/941] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:17.610306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.610948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:17.656696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:17.767577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c086-f369-4fbd-887b-3a87d4dff5d2 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.777280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495f055-66f3-4711-99e5-7f8ef3358178 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:17.829365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.830802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.831242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.831765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.832481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:17.832791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:17.833813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:17.834390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:17.834748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:17.835041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:17.836187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:17.836799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:17.839710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:17.848532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:17.849802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:34:17.850906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:17.853596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 463/942] 10.222.0.44 () {56 vars in 1132 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:17.859559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:17.877277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 480/943] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:17.883512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.023078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.032473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.037105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea3230-8769-45d1-a59f-8fce3a3f8a81 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.052535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b956-80b5-4c24-90c1-88d1d5861f72 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.086051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.086051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.086051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.086424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.086882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:18.087192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.089181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.095296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 464/944] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:18.107036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.113812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.115248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.116009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.116791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.131327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.134698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:18.160018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:18.161802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:18.163517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:18.168117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 481/945] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:18.176569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.337262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37a28-5daa-43d5-bfc1-ea71e765adb2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.416043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.417293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.418195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.419486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.421268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:18.421923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.425027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.431912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c3c87-2b99-46de-bc56-8aeee69eadbf None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.436323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 465/946] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:18.445551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.497735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.508061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.509522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.510292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.511000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.512866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:18.513735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.516860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.543058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 482/947] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:18.552346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:18.562229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:18.681828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158bfe-e47c-4e59-a973-aebc2c7c5aa0 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.698576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a998-2f34-4cf6-bab2-9d67ba0740cc None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:18.747230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09677300-6f0a-44e4-98f7-5fc6100d2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.748143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677300-6f0a-44e4-98f7-5fc6100d2f9e None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.748341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677300-6f0a-44e4-98f7-5fc6100d2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.748610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677300-6f0a-44e4-98f7-5fc6100d2f9e None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/b3a1aa24c712441f98b56c9307c93a65/roles/7da0a465d7bc4b67bffb4e4a807e77f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.751334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09677300-6f0a-44e4-98f7-5fc6100d2f9e None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=b3a1aa24c712441f98b56c9307c93a65, role_id=7da0a465d7bc4b67bffb4e4a807e77f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.752764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09677300-6f0a-44e4-98f7-5fc6100d2f9e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.767851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9610-6a04-4152-8dc7-53214be5b560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:18.769346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9610-6a04-4152-8dc7-53214be5b560 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:18.770143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9610-6a04-4152-8dc7-53214be5b560 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:18.770948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9610-6a04-4152-8dc7-53214be5b560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:18.772398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f9610-6a04-4152-8dc7-53214be5b560 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:18.775225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f9610-6a04-4152-8dc7-53214be5b560 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:18.778562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 483/948] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:18 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/b3a1aa24c712441f98b56c9307c93a65/roles/7da0a465d7bc4b67bffb4e4a807e77f4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:18.822185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 466/949] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:34:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:19.703673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe878-06cc-4482-bfb8-35db2eeab44d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.704197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe878-06cc-4482-bfb8-35db2eeab44d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.704646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fe878-06cc-4482-bfb8-35db2eeab44d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.707126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 484/950] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:19.716610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a513c50-b808-485b-a74b-1d444d288802 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:19.717128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a513c50-b808-485b-a74b-1d444d288802 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:19.717614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a513c50-b808-485b-a74b-1d444d288802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:19.749718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-0a513c50-b808-485b-a74b-1d444d288802 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:19.752557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-0a513c50-b808-485b-a74b-1d444d288802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:19.868305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 467/951] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:20.357570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe878-06cc-4482-bfb8-35db2eeab44d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.382676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345122cb-3937-49fa-8a69-662c9560656a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.383104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345122cb-3937-49fa-8a69-662c9560656a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.383524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345122cb-3937-49fa-8a69-662c9560656a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.385754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 468/952] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:20.392713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.392939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.393083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.400025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.417276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:20.420382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:20.461120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.505891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fe878-06cc-4482-bfb8-35db2eeab44d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.507156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 469/953] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:20.551020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.552048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.552547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.553095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.553882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.555449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:20.566387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:20.567563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:20.568496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:20.571034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 485/954] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:20.581826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.697041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500330-6592-4863-9969-3b1a0934c5ec None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.736693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:20.741482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:20.741954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:20.742570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:20.742912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:20.743787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:20.749059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:20.751939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:20.761210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 470/955] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:20.771132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.816990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:20.935763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5dbb-dae6-4e51-ad25-a535dd5391d6 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.992763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9dcca-f587-4105-b967-88645b642f37 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:20.995251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.008203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.009954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.010881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.011619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.013880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:21.014838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.017940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.030608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 486/956] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.040287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.057551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.059881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.060864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.061592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.063902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.067115 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.092848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.sql.core [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:34:21.092848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 09:34:21.092848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [parameters: {'user_id': 'a5b2910b47bc411abd09cbcdc83d9bc4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 09:34:21.092848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88074) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result.read() Oct 28 09:34:21.107283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:34:21.109059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application yield resource Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise self.value Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application session.commit() Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:34:21.110841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:34:21.112454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:34:21.114066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application result.read() Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:34:21.115571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a5b2910b47bc411abd09cbcdc83d9bc4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:21.118676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 28 09:34:21.123613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 28 09:34:21.126769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 28 09:34:21.126769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 28 09:34:21.126769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:34:21.126769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:34:21.126769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 09:34:21.126769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:21.127630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 471/957] 10.222.0.44 () {60 vars in 1131 bytes} [Fri Oct 28 09:34:20 2022] POST /identity/v3/users => generated 160 bytes in 310 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:21.132852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.206403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.236956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd637f-b56b-4a0e-8be7-1b71221a10e9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.266450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79eb5f-bec6-485c-975e-85f874ff5234 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.280292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409823-298f-4b67-a0ef-b0bc4d33014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.280904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409823-298f-4b67-a0ef-b0bc4d33014f None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.281180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409823-298f-4b67-a0ef-b0bc4d33014f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.281452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409823-298f-4b67-a0ef-b0bc4d33014f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.282218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99409823-298f-4b67-a0ef-b0bc4d33014f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.283614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99409823-298f-4b67-a0ef-b0bc4d33014f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.320277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 487/958] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:34:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:21.320277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85f992-4366-4f2c-9d20-1231eccb32cc None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.320277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85f992-4366-4f2c-9d20-1231eccb32cc None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.320277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85f992-4366-4f2c-9d20-1231eccb32cc None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.320277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 488/959] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:21.326870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.327450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.327976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.341089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.341898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.342304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.342587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.353405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.355086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.358447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:21.360567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:21.376839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:21.378722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:21.380152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 472/960] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:21.390255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.463077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.512498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 489/961] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:21.614046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002ff14-ceee-47c1-8e24-f432363276e8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:21.633435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:21.658559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:21.659588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:21.660075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:21.660609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:21.661584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:21.662127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:21.663848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:21.706226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 473/962] 10.222.0.44 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:21.831335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:21.961451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1500de1-86b5-47fb-ad80-840513c30c25 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.007015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2abcf-56e9-481d-9fe5-51c5e05ca9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.008058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2abcf-56e9-481d-9fe5-51c5e05ca9fe None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.008591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2abcf-56e9-481d-9fe5-51c5e05ca9fe None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.009069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2abcf-56e9-481d-9fe5-51c5e05ca9fe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.021831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2abcf-56e9-481d-9fe5-51c5e05ca9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-53d2abcf-56e9-481d-9fe5-51c5e05ca9fe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:22.027362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:22.028443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:22.029297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:22.031846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 490/963] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Oct 28 09:34:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:22.038322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.109496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1212d3-a335-4657-9e55-758f6894bb29 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.109979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1212d3-a335-4657-9e55-758f6894bb29 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.110470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1212d3-a335-4657-9e55-758f6894bb29 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.116298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 491/964] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:22.120548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.121019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.121461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.149471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:22.151598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:22.174109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd8068-0b4b-4cca-9000-9742c1e7a502 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.200734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.221588 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.222181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.222493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.222773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.223557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:22.224019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.225539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.237087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 474/965] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:22.243206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.256757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 492/966] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:22.287156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.389957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1d364-ffce-43ff-b120-3e27cf5be3e2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.454365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.455190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.455575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.455947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.469067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.470709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:22.486659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:22.487902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:22.489143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:22.489143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:22.489143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:22.490265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 475/967] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:22.495914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.522830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.610606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fce3d-23a5-42b4-8025-9d4ad9c66c32 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.624074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.643866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2311d-ebb7-4bd0-9504-f72a0cd5750f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.652416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.653123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.653402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.653675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.654343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:22.654651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.656082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.669958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 493/968] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:22.675556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.686247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.686916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.687200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.687476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.688083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.689527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:22.699451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:22.701295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:22.702130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 476/969] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:22.707413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.713827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.811439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfc29-ed27-4f87-ab5e-98d04b800361 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.833639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6052d41-c728-45e2-9769-945d9010ee72 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:22.854023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.854699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.854954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.855227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.865557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.867381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.873334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:22.873973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:22.874255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:22.874629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:22.875182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:22.875488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:22.876937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:22.880126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:22.881129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:22.882069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 494/970] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:22.884994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 477/971] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:22.887163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.891206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:22.909358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:22.994174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:23.006494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ff9a1-96ad-4571-b3f7-1cde973cf734 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:23.017617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0870-8374-4741-8992-36bf1101f669 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:23.046306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:23.047246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.047722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.048070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.048862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:23.049166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:23.050636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:23.057960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:23.058649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.058878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.059761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.060434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:23.060745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:23.062193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:23.068390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 478/972] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:23.080537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 495/973] 10.222.0.44 () {56 vars in 1149 bytes} [Fri Oct 28 09:34:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:23.089818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:23.254038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:23.294097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b2f8e-bbf4-4753-aef5-586bad0c5455 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:23.333693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:23.334330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.334608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.334879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.416111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:23.417656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:23.510335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:23.541709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 479/974] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:34:23.544503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:23.665529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a24be-df68-421e-acfd-b1e6e9efc724 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:23.708091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:23.708824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.709091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.709541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.722126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:23.723620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:23.734318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:23.743045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:23.745163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:23.747500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:23.747500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:23.747500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:23.750558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 496/975] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:23.752560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:23.925075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c8d90-feb1-4727-ab39-52650b86f077 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:23.968734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:23.969379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:23.969660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:23.969939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:23.970630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:23.970944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:23.972459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:23.987133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 480/976] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:23.993435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.150516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e3b87-4059-410d-9108-3c69c6f6570c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.197577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.198140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.198415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.198681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.207579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.210325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:24.227169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:24.233420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:24.235851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 497/977] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:24.244144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.321947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.423992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485a06-d1d3-49c6-948e-eb3673649e5f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.472918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.473810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.474233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.474653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.475506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:24.475971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.477693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01c619-aa30-48f3-a922-f749763ea13a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.493790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 481/978] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:24.504503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:24.533123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7702cce-f3ff-4914-8f5c-18d0c3be274a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.533405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7702cce-f3ff-4914-8f5c-18d0c3be274a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.533677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7702cce-f3ff-4914-8f5c-18d0c3be274a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.535127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 482/979] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:24.541245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.541245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.541554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.570760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:24.573880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:24.592976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:24.641657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77fdfb-fbc4-4c83-afeb-baba4d0f0d72 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:24.682559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:24.683285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:24.683632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:24.683960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:24.685396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] RBAC: Adding query filter params (role.id=7da0a465d7bc4b67bffb4e4a807e77f4, scope.project.id=862360b634994703825014c6d7c129f0, user.id=b3a1aa24c712441f98b56c9307c93a65) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:24.685766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:24.687403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:24.704276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 498/980] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/role_assignments?user.id=b3a1aa24c712441f98b56c9307c93a65&scope.project.id=862360b634994703825014c6d7c129f0&role.id=7da0a465d7bc4b67bffb4e4a807e77f4 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:24.708113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 483/981] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:24.984139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.127259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8619b-fd3d-4c3f-9dc3-4a55c91d64c6 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.158284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.173530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.174181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.174448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.174789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.175387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.177102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-8929835f-ef2d-4eb6-9f80-0642bc1fca1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:25.187858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:25.189835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:25.191471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:25.194336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 499/982] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:25.196439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.254520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.389354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aae02c-eefa-48b4-a7bd-eee770120458 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.438081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.438718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.438994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.439251 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.439904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:25.440204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.441649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.448526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 484/983] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.455459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.456532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f07e2-7aa2-49c1-8e44-379244891442 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.457180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f07e2-7aa2-49c1-8e44-379244891442 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.457816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f07e2-7aa2-49c1-8e44-379244891442 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.461332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 500/984] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:25.467640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.467898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.468216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.490489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:25.491734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:25.575718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 501/985] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:25.589279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.602103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60544492-3b33-4cbf-aeb0-0f93fde19647 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.646324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.646960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.647239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.647506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.648158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:25.648546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.649973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.656646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 485/986] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.664269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.851136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.858426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1859-0594-4825-9482-8114902d6a63 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:25.893204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:25.915757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:25.916430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:25.916825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:25.916988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:25.917695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] RBAC: Adding query filter params (interface=admin, service_id=8bff38b865db4d989b7cd367388427b6, region_id=RegionOne) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:25.918427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:25.927940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:25.932609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 502/987] 10.222.0.44 () {56 vars in 1249 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/endpoints?service_id=8bff38b865db4d989b7cd367388427b6&interface=admin®ion_id=RegionOne => generated 193 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:25.941675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:25.985887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1533f55-33aa-4c14-aed4-131f8431e61d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:26.028764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f397f8-0452-4b55-a7cd-8c645ce93115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:26.029536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f397f8-0452-4b55-a7cd-8c645ce93115 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:26.029815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f397f8-0452-4b55-a7cd-8c645ce93115 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:26.030083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f397f8-0452-4b55-a7cd-8c645ce93115 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:26.030752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f397f8-0452-4b55-a7cd-8c645ce93115 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:26.032160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f397f8-0452-4b55-a7cd-8c645ce93115 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:26.054692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 486/988] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:25 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:34:26.087747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14cf5-59b5-446d-ac2a-4eef37cddc50 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:26.145396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3d97-680e-40c5-82d7-7ee97aec5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:26.146394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3d97-680e-40c5-82d7-7ee97aec5516 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:26.146819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3d97-680e-40c5-82d7-7ee97aec5516 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:26.147249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3d97-680e-40c5-82d7-7ee97aec5516 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:26.148154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3d97-680e-40c5-82d7-7ee97aec5516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:26.149823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3d97-680e-40c5-82d7-7ee97aec5516 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:26.158521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 503/989] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:34:25 2022] GET /identity/v3/services => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:34:27.164504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1f02-b5fd-43c4-bc29-d0fdf481bac9 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.165992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1f02-b5fd-43c4-bc29-d0fdf481bac9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.166776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1f02-b5fd-43c4-bc29-d0fdf481bac9 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.171088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 487/990] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:27.176647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.177438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.177438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.198561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:27.200338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:27.257084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:27.303620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 504/991] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:27.584024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1f02-b5fd-43c4-bc29-d0fdf481bac9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.606056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:27.710077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1f02-b5fd-43c4-bc29-d0fdf481bac9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:27.756367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:27.757027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.757313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.757567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] PATH_INFO: `/v3/services/image` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.758161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:27.759563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:27.770053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:27.772197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:27.774073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:27.776719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 488/992] 10.222.0.44 () {56 vars in 1105 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:27.777347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:27.903979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347383-ed7d-4e9f-931f-5f594cca8d84 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:27.963883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:27.964978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.965551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.965937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.966995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] RBAC: Adding query filter params (name=image) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:27.967458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:27.969796 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8c709-cd1b-4237-bf69-096e158bf236 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:27.978412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 505/993] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:27.985123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:28.154763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:28.187813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a15d88-ec9b-4146-8ffd-19e365a13165 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:28.262732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:28.264657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.265201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.265633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.266833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:28.267404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:28.270040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d2ee3-6022-4ac4-8102-629d94a724b0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:28.280870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 489/994] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:28.761443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458a36-0ec4-4810-9dec-6455cba13ff0 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.763032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458a36-0ec4-4810-9dec-6455cba13ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.763032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458a36-0ec4-4810-9dec-6455cba13ff0 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.764639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 506/995] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:28.771444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc19ef-49f2-44fa-9585-3113ebab6727 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.772054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc19ef-49f2-44fa-9585-3113ebab6727 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.772668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc19ef-49f2-44fa-9585-3113ebab6727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.801665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6ccc19ef-49f2-44fa-9585-3113ebab6727 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:28.803661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6ccc19ef-49f2-44fa-9585-3113ebab6727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:28.948288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 490/996] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:28.994512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cf45f-7a25-496a-b960-c4afcd16926c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:28.994976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cf45f-7a25-496a-b960-c4afcd16926c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:28.995372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cf45f-7a25-496a-b960-c4afcd16926c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:28.997767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 507/997] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:29.004034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:29.004534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:29.004954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:29.026304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:29.027691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:29.118982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 491/998] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:29.406257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cf45f-7a25-496a-b960-c4afcd16926c None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:29.468371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:29.475915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:29.487841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:29.627464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cf45f-7a25-496a-b960-c4afcd16926c None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:29.659713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91265a68-74d0-42d3-aadb-a5de4055f5e3 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:29.691878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:29.692906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:29.693374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:29.693792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:29.694557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:29.696147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:29.711506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:29.713806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:29.715758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 508/999] 10.222.0.44 () {56 vars in 1126 bytes} [Fri Oct 28 09:34:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:29.722119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:29.731188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:29.732308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:29.733109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:29.733806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:29.735812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:29.739668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:29.758401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:29.759479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:29.760353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 492/1000] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:29.771454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:29.874564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:29.879099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a809d-61a5-4c8e-bd56-148fbff81a53 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:29.904191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:29.929656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:29.930265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:29.930535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:29.930795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:29.931435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:29.931737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:29.933179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:29.943152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 509/1001] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:29.948526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:29.980815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ea79-48d9-4e9d-a993-22cad0c56951 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:30.050671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:30.051754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.052268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.052769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.054036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:30.054551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:30.057241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:30.067370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 493/1002] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:30.074461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:30.109041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df434-903d-444b-a1fb-b1e321fb1a93 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:30.167548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:30.169298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.169880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.170262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.171437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:30.171977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:30.174703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:30.184554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 510/1003] 10.222.0.44 () {56 vars in 1122 bytes} [Fri Oct 28 09:34:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:30.191224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:30.230047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ad0cc-aaa1-4f87-8b0b-1083676fb0c7 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:30.248748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:30.285987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:30.292817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:30.294772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.295092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.295383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.296275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:30.296418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:30.297752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:30.312283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 494/1004] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:30.314831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:30.355450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f39ac9-078a-41a4-8e06-17d43f4bd52f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:30.411126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:30.412128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.412517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.412913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.414214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:30.416571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:30.447840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 511/1005] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:34:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:30.470474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9254081-62eb-4e64-a23d-fdc2032f780f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:30.524538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:30.525639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.526205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.526853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.528508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] RBAC: Adding query filter params (interface=public, service_id=19bc6eedacd743528003c3f573279d32, region_id=RegionOne) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:30.529131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:30.531079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118108-becb-4861-86db-11cfc22d0043 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:30.538544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 495/1006] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:34:30 2022] GET /identity/v3/endpoints?service_id=19bc6eedacd743528003c3f573279d32&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:30.546683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:30.707049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:30.735239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fe0e5-ee88-4a3b-8130-cb619300f067 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:30.803126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca601d-a346-4f8d-a01a-de8529bafe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:30.804359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca601d-a346-4f8d-a01a-de8529bafe64 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:30.804867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca601d-a346-4f8d-a01a-de8529bafe64 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:30.805370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca601d-a346-4f8d-a01a-de8529bafe64 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:30.806576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca601d-a346-4f8d-a01a-de8529bafe64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:30.809936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca601d-a346-4f8d-a01a-de8529bafe64 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:30.827464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 512/1007] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:34:30 2022] GET /identity/v3/services => generated 1727 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:34:31.377565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7566816-6fa8-4916-bf88-a514ccad584e None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.378062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7566816-6fa8-4916-bf88-a514ccad584e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.378521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7566816-6fa8-4916-bf88-a514ccad584e None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.380974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 496/1008] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:31.390911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004d29-1e1a-4497-929b-e7d30f3e8dab None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:31.391766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004d29-1e1a-4497-929b-e7d30f3e8dab None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:31.392189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004d29-1e1a-4497-929b-e7d30f3e8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:31.427281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-fe004d29-1e1a-4497-929b-e7d30f3e8dab None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:31.427281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-fe004d29-1e1a-4497-929b-e7d30f3e8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:31.566294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 513/1009] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:32.098165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7566816-6fa8-4916-bf88-a514ccad584e None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:32.210473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:32.269061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7566816-6fa8-4916-bf88-a514ccad584e None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:32.311570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d8e39-9815-4af7-9133-90acef9ed4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:32.312217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8e39-9815-4af7-9133-90acef9ed4be None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:32.312531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8e39-9815-4af7-9133-90acef9ed4be None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:32.312805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8e39-9815-4af7-9133-90acef9ed4be None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:32.313483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d8e39-9815-4af7-9133-90acef9ed4be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:32.314965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d8e39-9815-4af7-9133-90acef9ed4be None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:32.334435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 497/1010] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:32 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:33.216743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0bb30-3899-40a2-b6ba-f448074d3223 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.217407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0bb30-3899-40a2-b6ba-f448074d3223 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.217765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0bb30-3899-40a2-b6ba-f448074d3223 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.220397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 514/1011] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:33.227644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3b2b7-6c30-46c3-a6d1-dc460ede2c35 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.228227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3b2b7-6c30-46c3-a6d1-dc460ede2c35 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.228831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3b2b7-6c30-46c3-a6d1-dc460ede2c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.263142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-76c3b2b7-6c30-46c3-a6d1-dc460ede2c35 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:33.265299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-76c3b2b7-6c30-46c3-a6d1-dc460ede2c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:33.397239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 498/1012] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:33 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:33.491268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d717c-68a1-4a36-970d-98e871a2ce50 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.491689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d717c-68a1-4a36-970d-98e871a2ce50 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.492139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d717c-68a1-4a36-970d-98e871a2ce50 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.494914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 515/1013] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:33.505117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.505630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.506120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.539766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:33.541884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:33.614068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:33.682440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 499/1014] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:33 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:33.686661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d717c-68a1-4a36-970d-98e871a2ce50 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:33.797398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:33.824189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d717c-68a1-4a36-970d-98e871a2ce50 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:33.869886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:33.870690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:33.871094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:33.871493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:33.872501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:33.874313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:33.885292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:33.889383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:33.890278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 516/1015] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:33.897295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.091510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe50f-5929-4095-a806-878760444b88 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.157805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.158805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.159246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.159691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.160754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:34.161248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.163614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.179142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 500/1016] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:34.180874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.190218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.258548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.376781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a203f5-8a9d-426e-b0d2-46bef8333945 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.387113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02eb6-c7bd-4a2f-b29b-cd486d871418 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.446639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.447591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.448108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.448671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.449838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:34.450915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.453333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.455171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.456267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.456768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.457246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.459202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.462015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.469787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 517/1017] 10.222.0.44 () {56 vars in 1112 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:34.469979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 501/1018] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:34.471071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.479029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:34.495063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.636376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e74353-601a-44e2-a635-186f9f01a80e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.681618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c3eea-cd9c-4c8d-8c36-45caeffa4ae5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:34.686276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e4c8-cb31-4408-99e8-f90a268fc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.686641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.686908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e4c8-cb31-4408-99e8-f90a268fc27d None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.687190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e4c8-cb31-4408-99e8-f90a268fc27d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.687966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e4c8-cb31-4408-99e8-f90a268fc27d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.688303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e4c8-cb31-4408-99e8-f90a268fc27d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.689933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e4c8-cb31-4408-99e8-f90a268fc27d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.724298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 518/1019] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:34:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:34.724298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1235e-e425-4353-ba42-3caf8bda0d50 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.724298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1235e-e425-4353-ba42-3caf8bda0d50 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.724298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1235e-e425-4353-ba42-3caf8bda0d50 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.724298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 519/1020] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:34.734015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.734513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.734988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.748623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:34.749273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:34.749554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:34.749825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:34.750520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:34.752085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:34.768996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:34.773142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:34.791522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 502/1021] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:34 2022] POST /identity/v3/projects => generated 311 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:34.925543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:34.939995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 520/1022] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:35.293004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.447849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42f8e-6eb4-4aa5-8942-0781a3b12835 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.491752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.492445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.492725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.493072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] PATH_INFO: `/v3/services/image` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.493686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.495086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:35.505698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:35.507618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:35.509238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 503/1023] 10.222.0.44 () {56 vars in 1105 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:35.514257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.704447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18b566-5ef4-4837-9bf3-aac9262fe018 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:35.766401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:35.767432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.767917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.768445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.769619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] RBAC: Adding query filter params (name=image) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:35.770178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:35.772935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:35.788039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 521/1024] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:35.789661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:35.827943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:35.984124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb09fc-453d-4281-8a35-095e4a6c263c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.048166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.049248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.049697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.050162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.051271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] RBAC: Adding query filter params (type=image) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:36.051831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.054393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.069420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 504/1025] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:36.071021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.166218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.215759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2ada-33cd-415f-abbb-453e133b1167 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.254289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.254825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.255104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.255376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.256092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] RBAC: Adding query filter params (interface=public, service_id=0ed0fe6c1e5b433288ae23f90ca356ee, region_id=RegionOne) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:36.256485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.257883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1681faa-e1a1-4e75-95c4-509df12d6480 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.264675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 522/1026] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/endpoints?service_id=0ed0fe6c1e5b433288ae23f90ca356ee&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:36.270535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.369477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:36.405216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25e18-8d74-4bbe-b8d1-dd15d9a31b87 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.467607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1011d1b-ea07-4459-ab49-38cadb1e329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.468616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011d1b-ea07-4459-ab49-38cadb1e329b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.469081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011d1b-ea07-4459-ab49-38cadb1e329b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.469556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011d1b-ea07-4459-ab49-38cadb1e329b None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.470575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1011d1b-ea07-4459-ab49-38cadb1e329b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.473125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1011d1b-ea07-4459-ab49-38cadb1e329b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.492529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 505/1027] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/services => generated 1957 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:34:37.417775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8063e9-282f-4d1f-a706-60644108b48b None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.418807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8063e9-282f-4d1f-a706-60644108b48b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.419316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8063e9-282f-4d1f-a706-60644108b48b None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.421719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 523/1028] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:37.434276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.435509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.435826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.469317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:37.471482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:37.525471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666125-bebc-4935-913e-bf98a176c5b9 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.525939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666125-bebc-4935-913e-bf98a176c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.526427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666125-bebc-4935-913e-bf98a176c5b9 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.529678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 524/1029] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:37.538404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:37.538884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:37.539370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:37.572261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:37.574195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:37.588302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 506/1030] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:37.708563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 525/1031] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:37.866692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:37.960321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:37.998682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0d15d-6777-4c2c-a339-0a099bfb528b None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.046673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.047344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.047622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.047894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.061555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:38.066549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:38.069026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:38.072335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:38.074439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 507/1032] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Oct 28 09:34:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:38.076292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.185259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:38.246001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.281657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd07bb9-61a3-4824-8961-9902fe1b98e7 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.340495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.342053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.342497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.342946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.344164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:38.344732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.347279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.376874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 526/1033] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:38.379585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.398106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7742d-645f-4b5d-8633-7a552b11cde0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.459599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.460855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.461327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.461963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.464935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.468235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.472320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 508/1034] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:38.480991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.485790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:38.576552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5822f9-e8d7-4f8a-bbb0-55f648eb8edc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.607914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:38.638652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155da005-857f-4dc8-bd29-c828e182a46a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.641061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.642154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.642638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.643140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.661722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.664068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:38.690787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:38.691880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:38.692852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:38.692852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:38.692852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:38.693699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 527/1035] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:38.701993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:38.708864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.709842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.710124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.710410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.711148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.712955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.741375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 509/1036] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:38 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:34:38.906656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74babd85-137f-49b0-b350-28b9e84537cc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:38.972515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:38.973454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.973881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.974302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.975349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:38.975839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:38.978127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:38.997309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 528/1037] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:39.004479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.115052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:39.197075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eec73-bd20-41de-aae1-ae8a824275af None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.261676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.263359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.263868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.264385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] PATH_INFO: `/v3/users/nova` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.279626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:39.282407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-463247b4-18c9-4d58-a963-dc0c041b14de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:39.305385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:39.306579 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:39.307616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:39.308350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 510/1038] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:39.317308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.381253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:39.382603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8748ec-7681-4ff2-827e-117d7228b8c5 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.382898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8748ec-7681-4ff2-827e-117d7228b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.383179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8748ec-7681-4ff2-827e-117d7228b8c5 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.386335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 511/1039] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:39.393290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.393742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.394212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.425087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:39.426861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:39.523779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33d9d-b6ae-4113-9afc-f78bc15830db None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.552320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 512/1040] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:39.593971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.594980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.595480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.595951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.597348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:39.597888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:39.600678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:39.644280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 529/1041] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:39.647298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.746784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:39.838991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5980-a0c5-4c58-84b1-45d5b16f77e2 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.877287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.884313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.884954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.885230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.885502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.975801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:39.977358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.007617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.033565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af781ba-0bc3-43b4-9978-401b80fdf4f5 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.045170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.080466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.081323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.081725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.082127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] PATH_INFO: `/v3/services/image` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.082886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.084479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:40.100338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:40.102334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:40.103381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 530/1042] 10.222.0.44 () {56 vars in 1105 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/services/image => generated 86 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:40.109337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.130075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 513/1043] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:34:40.131823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.250283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad23d4-f579-4478-a41a-afadd5d9ec4e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.267120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac4a50-fa67-47fb-b45c-7e9a7d759b3a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.299804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.300772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.301143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.301501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.302256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] RBAC: Adding query filter params (name=image) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:40.302652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.304166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.313400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 531/1044] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:40.319557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.320594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.321837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.322795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.325153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.338797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.353213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.357308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.373584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:40.379768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:40.381039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:40.382124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:40.382124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:40.382124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:40.389020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 514/1045] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:40.390296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.507426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405d8ed-085f-4202-8de2-6d2ff61821ec None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.522474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aef4f-9b25-4c08-b533-451e2353b954 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.562452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.563300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.563569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.563719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.564275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] RBAC: Adding query filter params (type=image) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:40.564649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.566068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.569700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.570545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.570751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.571078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.571764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:40.572106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.573650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 532/1046] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:40.573830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.580160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.596578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 515/1047] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:40.602494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:40.680518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.706785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8298cc9-4391-456e-9a6b-208b2ceebc50 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.732734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:40.746045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.746666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.747167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.747386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.748350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.749753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.775280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 533/1048] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:34:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:34:40.803477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0e4a4-68a0-485f-bf05-2c989f49b223 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:40.862118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:40.863015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:40.863447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:40.863852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:40.873305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:40.875085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:40.889843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:40.891712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:40.898467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 516/1049] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:40.901992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.050549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca5b-c290-4098-893f-4236b54c8070 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.117700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.118773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.119278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.119732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.121076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:41.121620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:41.124991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545be7-a8ab-497f-ab49-f55ef440f1be None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:41.128262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.152635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 534/1050] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:41.161015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.360327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76b20-d549-4220-a57a-7e959e1956e6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.397301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.438498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.439596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.440093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.440609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.441942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] RBAC: Adding query filter params (role.id=7da0a465d7bc4b67bffb4e4a807e77f4, scope.project.id=862360b634994703825014c6d7c129f0, user.id=7b34a8c7d4f242c3a5be691db48cc0d5) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:41.442412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:41.444875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195d25-0303-4f00-8060-ae07fe79edd5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:41.456329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 517/1051] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/role_assignments?user.id=7b34a8c7d4f242c3a5be691db48cc0d5&scope.project.id=862360b634994703825014c6d7c129f0&role.id=7da0a465d7bc4b67bffb4e4a807e77f4 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:41.558615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ed782-d1a7-4464-aba2-e5aac888d1fa None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.559059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ed782-d1a7-4464-aba2-e5aac888d1fa None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.559218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ed782-d1a7-4464-aba2-e5aac888d1fa None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.561245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 535/1052] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:41.567355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.567734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.567954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.590173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:41.591719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:41.684003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 518/1053] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:41.995764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ed782-d1a7-4464-aba2-e5aac888d1fa None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.223869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ed782-d1a7-4464-aba2-e5aac888d1fa None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.288191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.289065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.289517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.289983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.309671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:42.318924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:42.320034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:42.321502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:42.322877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 536/1054] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:42.330751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.467646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06da774-6872-4878-aa27-d79d4913b9c0 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.482952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.517259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.518078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.518495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.518902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.519868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:42.520424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.522004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.539102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 519/1055] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:42.545700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.618557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.681096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd035c-4851-422a-b276-13f74fc8becf None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.728169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.728857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.729139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.729417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] PATH_INFO: `/v3/users/fa3548fdc4e74a8face1a42f76f79761` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.750217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] RBAC: Authorizing `identity:get_user(user_id=fa3548fdc4e74a8face1a42f76f79761)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.751828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.759947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 537/1056] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/users/fa3548fdc4e74a8face1a42f76f79761 => generated 285 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:42.765453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.931094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eafa1-b69e-425e-9576-ae5c6578ed44 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.975088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.975766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.976039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.976342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.065254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:43.121268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.125998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.287954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 520/1057] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:34:43.299971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:43.457894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5459-cae0-4ba4-a497-aaf2e12e3e5d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.476371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:43.507146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e250c10-32cc-4b59-ab6f-e95886d6d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.507522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250c10-32cc-4b59-ab6f-e95886d6d093 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.507826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250c10-32cc-4b59-ab6f-e95886d6d093 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.508078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250c10-32cc-4b59-ab6f-e95886d6d093 None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.509332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e250c10-32cc-4b59-ab6f-e95886d6d093 None admin] RBAC: Authorizing `identity:get_project(project_id=f1904933f69b46c1bf1e253e1c07f65f)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.510801 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e250c10-32cc-4b59-ab6f-e95886d6d093 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.512906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 538/1058] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:43 2022] GET /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f => generated 311 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:43.523875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:43.668587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:43.732185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0a7b0-f656-4419-8749-05df8f39d243 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:43.798340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:43.799370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.799848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.800377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.801802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=f1904933f69b46c1bf1e253e1c07f65f, user.id=fa3548fdc4e74a8face1a42f76f79761) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:43.802350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:43.805126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20896-6191-4cfb-be81-7786434b6702 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:43.824287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 521/1059] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:43 2022] GET /identity/v3/role_assignments?user.id=fa3548fdc4e74a8face1a42f76f79761&scope.project.id=f1904933f69b46c1bf1e253e1c07f65f&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:43.896615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82369-6aa4-4354-bbbb-accb2b835cdc None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.896992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82369-6aa4-4354-bbbb-accb2b835cdc None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.897408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82369-6aa4-4354-bbbb-accb2b835cdc None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.899058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 539/1060] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:43.906019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e6fb-95c1-4ed0-bb86-6cc396db27e2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:43.906486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e6fb-95c1-4ed0-bb86-6cc396db27e2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:43.906894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e6fb-95c1-4ed0-bb86-6cc396db27e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:43.928815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ae18e6fb-95c1-4ed0-bb86-6cc396db27e2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:43.930210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ae18e6fb-95c1-4ed0-bb86-6cc396db27e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:44.020332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 522/1061] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:44.296425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a82369-6aa4-4354-bbbb-accb2b835cdc None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:44.475477 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a82369-6aa4-4354-bbbb-accb2b835cdc None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:44.521019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:44.521652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.521930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.522204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.543660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6de8d-5880-4009-9ce0-19468d7c5043 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.544793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6de8d-5880-4009-9ce0-19468d7c5043 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.545181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6de8d-5880-4009-9ce0-19468d7c5043 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.547560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 523/1062] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:44.553736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:44.554084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:44.554291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:44.575947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:44.577361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:44.609534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:44.648732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:44.651555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:44.658168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:44.672320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 524/1063] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:44.844300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 540/1064] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:34:44.850007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:44.952802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.047063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad779d9-309e-435f-a78b-ef9f60c7b756 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.069319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.096742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.097856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.098217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.098660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.109442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaec9e5-911f-44d2-911d-615ead046fc1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.117450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.119997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:45.147805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:45.149849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:45.151711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:45.151711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:45.151711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:45.151711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 525/1065] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:45.157510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.177775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.178779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.179219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.179659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.199413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:45.209173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:45.211021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:45.212740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 541/1066] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Oct 28 09:34:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:45.219223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.257045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.352992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320b7d7-7d97-4c88-9a6c-7c6fbf464ad5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.397678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa9e31-9e7b-4041-b5d8-bff94aef9c3c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.420616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.421647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.422144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.422652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.425918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:45.425918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.427024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.452222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.460702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 526/1067] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:45.460989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.460989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.460989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.460989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:45.460989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.460989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.474658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 542/1068] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:45.483759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.644286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df76472-bf28-4988-9d57-45a232eb2371 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.656879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.691363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.692052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.692371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.692651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.705976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.707501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:45.726820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:45.727881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:45.728885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:45.728885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:45.728885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:45.728885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 527/1069] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:45.737360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.742220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.867765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15028111-59c8-4c87-b721-0c8fdb83f003 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.933053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.933889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.934309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.935045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.937104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:45.937104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.939045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.955764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 543/1070] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:45.962276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.147154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba9a16-d40d-4893-8c93-f522ab7054e5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.197493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.198208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.198586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.198965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.209034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.210530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:46.223812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:46.233264 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:46.235325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 528/1071] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:34:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:46.236585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.307999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.382933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f988-d0dc-473f-a45e-6d0a05127149 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.447236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.448353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.448859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.449332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.450820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:46.451351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.454340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6beb-9b42-42cf-a219-8268100387ca None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.488398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 544/1072] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:46.495359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.522208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.626384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c86b-0bfd-4589-b384-618862f71de0 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.669498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.670330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.670706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.671069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.675980 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4d69-49c2-4b31-921a-f674c18078ce None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.676337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4d69-49c2-4b31-921a-f674c18078ce None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.676556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4d69-49c2-4b31-921a-f674c18078ce None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.677927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 545/1073] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:46.684086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.684797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.685238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.686099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.688050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.706487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:46.707598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:46.713237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:46.715208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:46.717328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:46.717328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:46.717328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:46.717328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 529/1074] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:46.723260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.797155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 546/1075] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:46.811826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.848942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd4ae5-f672-494a-8bdd-7b6b97c256d3 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.893214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.893855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.894140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.894416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.895078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:46.895390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.896862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.912619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 530/1076] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:46.918647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.980191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.047982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b8549-62a0-4df2-b5c3-e3a2c3453a62 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.095998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.103731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.104575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.105041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.105410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.114664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.116485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:47.131863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:47.133862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:47.135174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 547/1077] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:47.142368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.243998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cc477-2bd1-4b19-8200-223dd1a4f81e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.282193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f0615-6f71-40fd-94eb-38214efb1ebd None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.286774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.293926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.295542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.295873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.296352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.298133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.312570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:47.321624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:47.322654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:47.323491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 531/1078] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:47.333523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.334470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.335100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.335388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.335654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.336421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:47.336727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.338234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.352865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 548/1079] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:47.362792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.490237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc929b-88c4-4db2-a3b9-cd0ef3af0cb5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.491999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123242ff-91fe-46e5-abc5-1effa52854ad None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.532821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.533339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.533615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.533885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.534563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:47.534871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.536362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.541426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.542469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.542921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.543363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/7b34a8c7d4f242c3a5be691db48cc0d5/roles/7da0a465d7bc4b67bffb4e4a807e77f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.547442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=7b34a8c7d4f242c3a5be691db48cc0d5, role_id=7da0a465d7bc4b67bffb4e4a807e77f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.549855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.551478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 532/1080] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:47.558495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.568952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 549/1081] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:47 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/7b34a8c7d4f242c3a5be691db48cc0d5/roles/7da0a465d7bc4b67bffb4e4a807e77f4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:34:47.634743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.695478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852c64e-9a12-49c6-b066-88f509484505 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.741776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.742803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.743125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.743514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] PATH_INFO: `/v3/users/fa3548fdc4e74a8face1a42f76f79761` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.745036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] RBAC: Authorizing `identity:get_user(user_id=fa3548fdc4e74a8face1a42f76f79761)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.746657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.749097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 533/1082] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/users/fa3548fdc4e74a8face1a42f76f79761 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:47.758346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.806594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.895376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcec10-08af-4cb1-9a0a-e689264b6704 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.946063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecc956-e42d-4102-862f-14f99543712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.947309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecc956-e42d-4102-862f-14f99543712d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.947852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecc956-e42d-4102-862f-14f99543712d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.948458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecc956-e42d-4102-862f-14f99543712d None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.951866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecc956-e42d-4102-862f-14f99543712d None admin] RBAC: Authorizing `identity:get_project(project_id=f1904933f69b46c1bf1e253e1c07f65f)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.954884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecc956-e42d-4102-862f-14f99543712d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.959249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 550/1083] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:47.969533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:48.137378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4867e5-7afb-4411-9ba9-b73df6992f1c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:48.167653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:48.183809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1f1a3-5b71-4783-8e18-18d967aab3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:48.185324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f1a3-5b71-4783-8e18-18d967aab3b8 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:48.185714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f1a3-5b71-4783-8e18-18d967aab3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:48.186089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f1a3-5b71-4783-8e18-18d967aab3b8 None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f/users/fa3548fdc4e74a8face1a42f76f79761/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:48.188317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f1a3-5b71-4783-8e18-18d967aab3b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1904933f69b46c1bf1e253e1c07f65f, user_id=fa3548fdc4e74a8face1a42f76f79761, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:48.189909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f1a3-5b71-4783-8e18-18d967aab3b8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.206191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 534/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:34:47 2022] PUT /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f/users/fa3548fdc4e74a8face1a42f76f79761/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:34:50.132555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3ae9-38d9-4410-a46e-4a9f9c24a79f None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.133397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3ae9-38d9-4410-a46e-4a9f9c24a79f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.133397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3ae9-38d9-4410-a46e-4a9f9c24a79f None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.135851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 551/1085] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:50.143092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2359-5132-4327-9d79-e138667c270a None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.143899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2359-5132-4327-9d79-e138667c270a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.143899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2359-5132-4327-9d79-e138667c270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.164663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-583b2359-5132-4327-9d79-e138667c270a None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:50.165982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-583b2359-5132-4327-9d79-e138667c270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:50.250391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 535/1086] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:50.531984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc3ae9-38d9-4410-a46e-4a9f9c24a79f None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.653060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.659299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc3ae9-38d9-4410-a46e-4a9f9c24a79f None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.701650 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7fc8-8cd8-4a13-b135-85d42faefdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.702402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7fc8-8cd8-4a13-b135-85d42faefdab None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.702678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7fc8-8cd8-4a13-b135-85d42faefdab None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.702946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7fc8-8cd8-4a13-b135-85d42faefdab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.715083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b7fc8-8cd8-4a13-b135-85d42faefdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0f5b7fc8-8cd8-4a13-b135-85d42faefdab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:50.720314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:50.721620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:50.722595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 552/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:50.728670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2359-5132-4327-9d79-e138667c270a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.768380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2280d-6a9e-4034-8c01-3ec0a0eefa7c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.768889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2280d-6a9e-4034-8c01-3ec0a0eefa7c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.769395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2280d-6a9e-4034-8c01-3ec0a0eefa7c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.772201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 553/1088] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:50.781316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.781826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.782363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.815055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:50.817316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:50.863366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2359-5132-4327-9d79-e138667c270a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.881074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.903933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 554/1089] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:34:50.909249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.909952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.910286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.910614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.911361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:50.911715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:50.913243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:50.923707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 536/1090] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:50.930387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.084806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.108906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795af6e-a888-4e4b-b884-13f7e8614d42 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.173658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.174763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.175113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.175589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.189551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.191042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.191492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:51.208412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:51.210826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:51.212760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:51.212760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:51.212760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:51.212760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 555/1091] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:51.215609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.314091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a50d4-b8d1-4089-90e2-bf6026b1479c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.344054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f21d5-a30b-4d4c-b314-b1b498c07a0d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.358846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.359501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.359781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.360053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.374353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:51.379565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:51.380785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:51.381685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 537/1092] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:51.389261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.389953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.390237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.390513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.390896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.391209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:51.391516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.392955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.403088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.407915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 556/1093] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:51.414661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.436155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.518195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996498ca-0235-4961-bc8f-abfcf70a0875 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.539104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b883c-d5b6-4179-b466-3d654d4201bc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.558274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.558947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.559262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.560427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.560849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:51.561398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.562924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.572799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 538/1094] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:51.579702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.580006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.580383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.580661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.580934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.589129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.591261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:34:51.608394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:51.610257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:51.612080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 557/1095] 10.222.0.44 () {56 vars in 1093 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:51.615799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.686847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.698416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.707191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364948de-2d40-45a1-bc40-30f82dd09d3a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.739470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ff863-f0db-4956-80d9-9030104e2d4f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.758242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.759272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.759724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.760189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] PATH_INFO: `/v3/users/fa3548fdc4e74a8face1a42f76f79761` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.762135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] RBAC: Authorizing `identity:get_user(user_id=fa3548fdc4e74a8face1a42f76f79761)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.764737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.772827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 539/1096] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/users/fa3548fdc4e74a8face1a42f76f79761 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:51.774389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.788727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.789481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.789773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.790055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.790797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:51.791109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.792590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.819283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 558/1097] 10.222.0.44 () {56 vars in 1133 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:51.820577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:51.895869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72730-41a0-411e-8316-aa6e43a7f0ba None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.935319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.936497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.936958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.937233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.944158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463573b4-f331-4341-92ec-28e0949bee66 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.967224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.975739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:51.989425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.990048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.990330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.990612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.018089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.019595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.068996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.070735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.143172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 540/1098] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:34:52.149891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.206365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 559/1099] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:34:52.213583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.228297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.244523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.273747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c23a99-055c-4168-a2dd-34691ddf803e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.318080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.319082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.319524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.319973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.321896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] RBAC: Authorizing `identity:get_project(project_id=f1904933f69b46c1bf1e253e1c07f65f)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.324440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.327206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 541/1100] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:52.337558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.359726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc9e0-3f10-4e79-a369-b5109c9a7a16 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.405118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.405680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.405963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.406234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.417378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.418987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:52.437328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:52.438595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:52.439878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:52.439878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:52.439878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:34:52.439878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 560/1101] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:52.444615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.483187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f6c1-9b1a-4d98-84b6-26ed3652b64f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.517969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.524517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.525188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.525417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.525691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.526548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=f1904933f69b46c1bf1e253e1c07f65f, user.id=fa3548fdc4e74a8face1a42f76f79761) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:52.526857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.528923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.535809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 542/1102] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/role_assignments?user.id=fa3548fdc4e74a8face1a42f76f79761&scope.project.id=f1904933f69b46c1bf1e253e1c07f65f&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:52.549792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:52.589830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eb6db-a5dc-44ca-863e-15b7f8965672 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.636584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.637382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.638581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.638891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.639718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:52.640134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.642014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.666193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 561/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:52.667390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:52.799238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6e2c-6761-4fc6-9d60-6f49f56d0967 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:52.842352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:52.843145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:52.843544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:52.843912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:52.852576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:52.854253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:34:52.868085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:52.869920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:34:52.871783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 543/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:52.877799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.000960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60759-80a3-4e26-b278-fbf203313ab9 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.035229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.042553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.043178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.043454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.043727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.045018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:53.045324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.046823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eced83-7bf2-4a09-ae62-a10cb30e4d44 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.061953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 562/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:53.069069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.156441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.209526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2fa26-6451-4803-b975-10749038d99a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.255153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.256205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.256707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.257084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.257950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] RBAC: Adding query filter params (role.id=7da0a465d7bc4b67bffb4e4a807e77f4, scope.project.id=862360b634994703825014c6d7c129f0, user.id=7b34a8c7d4f242c3a5be691db48cc0d5) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:53.258365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.259966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5e4bd-a464-4c67-9141-1ec45c0503be None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.267425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 544/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:53 2022] GET /identity/v3/role_assignments?user.id=7b34a8c7d4f242c3a5be691db48cc0d5&scope.project.id=862360b634994703825014c6d7c129f0&role.id=7da0a465d7bc4b67bffb4e4a807e77f4 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:54.925685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffef87b-7eff-4a97-882e-4a401016502b None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:54.926442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffef87b-7eff-4a97-882e-4a401016502b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:54.926442 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffef87b-7eff-4a97-882e-4a401016502b None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:54.927935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 563/1107] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:54.934074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:54.934707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:54.934890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:54.956391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:54.957665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:55.033949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 545/1108] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:55.333179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffef87b-7eff-4a97-882e-4a401016502b None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:55.455671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffef87b-7eff-4a97-882e-4a401016502b None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:55.495487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c79bd-fc05-4265-b6a1-a158c297ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:55.496186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c79bd-fc05-4265-b6a1-a158c297ae0e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:55.496534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c79bd-fc05-4265-b6a1-a158c297ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:55.496853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c79bd-fc05-4265-b6a1-a158c297ae0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:55.498713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c79bd-fc05-4265-b6a1-a158c297ae0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:55.500233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c79bd-fc05-4265-b6a1-a158c297ae0e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:55.502015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 564/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:55.508342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:55.564890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:55.622132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deefda4-5e96-4c86-aa68-c8598b23e4d4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:55.660735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95347d-7366-411f-b840-b8964b46ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:55.661374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95347d-7366-411f-b840-b8964b46ea83 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:55.661656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95347d-7366-411f-b840-b8964b46ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:55.661928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95347d-7366-411f-b840-b8964b46ea83 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:55.662612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95347d-7366-411f-b840-b8964b46ea83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:55.664103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95347d-7366-411f-b840-b8964b46ea83 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:55.690020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 546/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:55 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:34:58.204906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3ccd-af37-49fc-be38-d657750ea9e1 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.205474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3ccd-af37-49fc-be38-d657750ea9e1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.205474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3ccd-af37-49fc-be38-d657750ea9e1 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.206790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 565/1111] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:58.212923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.213568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.213684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.235145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:58.236537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:58.315661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 547/1112] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:34:58.598890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3ccd-af37-49fc-be38-d657750ea9e1 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.668947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.718471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3ccd-af37-49fc-be38-d657750ea9e1 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.758198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.758886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.759167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.759443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] PATH_INFO: `/v3/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.760932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] RBAC: Authorizing `identity:get_role(role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.762323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.764302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 566/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:58.770397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.808854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.885126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14d6d8-72f8-48c3-999e-59e43de731e6 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.924644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.925292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.925574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.925846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] PATH_INFO: `/v3/users/0111971e25e14386b356f63f6606f4f7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.942342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] RBAC: Authorizing `identity:get_user(user_id=0111971e25e14386b356f63f6606f4f7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.943819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.945613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 548/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/users/0111971e25e14386b356f63f6606f4f7 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.955190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.137783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa38b-1093-4cc7-8922-c813da53af59 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.186447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.203435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.204524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.205009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.205538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.331485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.334427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.490365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 567/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:34:59.499724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.609697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.617815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2e1c-9caa-4119-a787-aa6e66353b1f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.657106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2ff0-07d5-4116-a598-70a2a5a6cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.657817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2ff0-07d5-4116-a598-70a2a5a6cc2c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.658145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2ff0-07d5-4116-a598-70a2a5a6cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.658465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2ff0-07d5-4116-a598-70a2a5a6cc2c None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.659768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2ff0-07d5-4116-a598-70a2a5a6cc2c None admin] RBAC: Authorizing `identity:get_project(project_id=f1904933f69b46c1bf1e253e1c07f65f)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.661411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2ff0-07d5-4116-a598-70a2a5a6cc2c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.663179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 549/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.670529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.701476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.786479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f97018-01ba-495c-81db-fefa7e53057e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.823977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.824630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.824912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.825630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.826082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] RBAC: Adding query filter params (role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=f1904933f69b46c1bf1e253e1c07f65f, user.id=0111971e25e14386b356f63f6606f4f7) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:59.826510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.828094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970505f9-8587-4f9d-8bd0-336c34d3569a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.834710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 568/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/role_assignments?user.id=0111971e25e14386b356f63f6606f4f7&scope.project.id=f1904933f69b46c1bf1e253e1c07f65f&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.211218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db92aa-8535-4c65-9b8d-bbb2a55f510b None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.211794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db92aa-8535-4c65-9b8d-bbb2a55f510b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.211794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db92aa-8535-4c65-9b8d-bbb2a55f510b None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.213155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 550/1118] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:02.220060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.220653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.220653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.240162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:02.241550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:02.318724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 569/1119] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:02.595998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db92aa-8535-4c65-9b8d-bbb2a55f510b None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.715086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db92aa-8535-4c65-9b8d-bbb2a55f510b None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.755259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.755926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.756203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.756509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] PATH_INFO: `/v3/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.758048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] RBAC: Authorizing `identity:get_role(role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.759455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.760880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 551/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.767524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.793503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.886121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711cc7-1487-45d9-9479-15d218cbd75e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:02.924834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:02.925483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.925761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.926033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] PATH_INFO: `/v3/users/0111971e25e14386b356f63f6606f4f7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.927233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] RBAC: Authorizing `identity:get_user(user_id=0111971e25e14386b356f63f6606f4f7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:02.928722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:02.930366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 570/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/users/0111971e25e14386b356f63f6606f4f7 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.937383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:02.971323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.050800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2f978-2bac-4c7a-ac24-3091e8a8e938 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.092316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c74636-a7b0-4341-9fb5-1801644b9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.093026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c74636-a7b0-4341-9fb5-1801644b9d3a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.093354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c74636-a7b0-4341-9fb5-1801644b9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.093675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c74636-a7b0-4341-9fb5-1801644b9d3a None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.094947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c74636-a7b0-4341-9fb5-1801644b9d3a None admin] RBAC: Authorizing `identity:get_project(project_id=f1904933f69b46c1bf1e253e1c07f65f)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.096563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c74636-a7b0-4341-9fb5-1801644b9d3a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.098918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 552/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:03.105799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.206450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.223072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ac54-7507-43ac-9b46-8c58f37ea341 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.265213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eb3f6-65a5-4217-9ee9-b5e0ae2de815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.265960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eb3f6-65a5-4217-9ee9-b5e0ae2de815 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.266276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eb3f6-65a5-4217-9ee9-b5e0ae2de815 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.266746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eb3f6-65a5-4217-9ee9-b5e0ae2de815 None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f/users/0111971e25e14386b356f63f6606f4f7/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.269244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907eb3f6-65a5-4217-9ee9-b5e0ae2de815 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1904933f69b46c1bf1e253e1c07f65f, user_id=0111971e25e14386b356f63f6606f4f7, role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.270722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907eb3f6-65a5-4217-9ee9-b5e0ae2de815 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.285960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 571/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:03 2022] PUT /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f/users/0111971e25e14386b356f63f6606f4f7/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:05.528181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100707f0-64a1-4db7-af77-ecb3a6e335e3 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.529048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100707f0-64a1-4db7-af77-ecb3a6e335e3 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.529209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100707f0-64a1-4db7-af77-ecb3a6e335e3 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.531605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 553/1124] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:05.540367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.541156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.541349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.562891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:05.564111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:05.686997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 572/1125] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:06.192720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100707f0-64a1-4db7-af77-ecb3a6e335e3 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.322730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.329320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100707f0-64a1-4db7-af77-ecb3a6e335e3 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.368463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.369123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.369401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.369676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] PATH_INFO: `/v3/roles/9f5dfd74367c4061a3b5725926b26fbd` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.371348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] RBAC: Authorizing `identity:get_role(role_id=9f5dfd74367c4061a3b5725926b26fbd)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.373595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.375185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 554/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/roles/9f5dfd74367c4061a3b5725926b26fbd => generated 223 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.381401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.472030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.511287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd4eac-127e-421f-8e6e-4456c20ab158 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.572323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.573371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.573839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.574303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] PATH_INFO: `/v3/users/0111971e25e14386b356f63f6606f4f7` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.576381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] RBAC: Authorizing `identity:get_user(user_id=0111971e25e14386b356f63f6606f4f7)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.579076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.582102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 573/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/users/0111971e25e14386b356f63f6606f4f7 => generated 286 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:06.588430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.700618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e436-0641-4ba5-ae47-b397ea478128 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.739226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.739765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.740040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.740351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.778198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.818071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.819605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.929673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 555/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:06.938800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.052598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f8b4e-aabb-40a2-8e41-9e9716ce1177 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.091828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dece57-c6f4-4604-84e7-2d0a0949e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.092631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dece57-c6f4-4604-84e7-2d0a0949e6ad None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.092914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dece57-c6f4-4604-84e7-2d0a0949e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.093191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dece57-c6f4-4604-84e7-2d0a0949e6ad None admin] PATH_INFO: `/v3/projects/f1904933f69b46c1bf1e253e1c07f65f` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.094410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dece57-c6f4-4604-84e7-2d0a0949e6ad None admin] RBAC: Authorizing `identity:get_project(project_id=f1904933f69b46c1bf1e253e1c07f65f)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.095880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dece57-c6f4-4604-84e7-2d0a0949e6ad None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.097616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 574/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/projects/f1904933f69b46c1bf1e253e1c07f65f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:07.104345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.181482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.223740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d31d8-fc3b-4def-b437-8df87e9fcc32 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.262330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.263523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.263812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.264080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.264958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] RBAC: Adding query filter params (role.id=9f5dfd74367c4061a3b5725926b26fbd, scope.project.id=f1904933f69b46c1bf1e253e1c07f65f, user.id=0111971e25e14386b356f63f6606f4f7) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:07.265272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.266766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7e329-3e7c-48e9-a474-cc7f3a0c09f8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.273529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 556/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/role_assignments?user.id=0111971e25e14386b356f63f6606f4f7&scope.project.id=f1904933f69b46c1bf1e253e1c07f65f&role.id=9f5dfd74367c4061a3b5725926b26fbd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:09.651512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb80c-0a66-485d-9df7-ea0c2a85bb3c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.652040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb80c-0a66-485d-9df7-ea0c2a85bb3c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.652478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb80c-0a66-485d-9df7-ea0c2a85bb3c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.655592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 575/1131] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:09.661897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.662425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.662543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.683707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:09.685620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:09.766601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 557/1132] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:10.048679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb80c-0a66-485d-9df7-ea0c2a85bb3c None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.067503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.184880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb80c-0a66-485d-9df7-ea0c2a85bb3c None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.249823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de443984-372d-4ee6-b240-5873500fe01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.250907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de443984-372d-4ee6-b240-5873500fe01a None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.251387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de443984-372d-4ee6-b240-5873500fe01a None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.251865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de443984-372d-4ee6-b240-5873500fe01a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.253715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de443984-372d-4ee6-b240-5873500fe01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.255266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de443984-372d-4ee6-b240-5873500fe01a None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.257008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 576/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:10.263276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.330922 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.380461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e525624-23ad-43b2-99eb-bed575c39b37 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.421351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb4f44-e52d-41f0-ab85-e2e604a9862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.422005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb4f44-e52d-41f0-ab85-e2e604a9862f None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.422281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb4f44-e52d-41f0-ab85-e2e604a9862f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.422554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb4f44-e52d-41f0-ab85-e2e604a9862f None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.423238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb4f44-e52d-41f0-ab85-e2e604a9862f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.424769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb4f44-e52d-41f0-ab85-e2e604a9862f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.462210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 558/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:10 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:12.846300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179bcec-1a79-417b-aca5-f08664a6f69e None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.847005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179bcec-1a79-417b-aca5-f08664a6f69e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.847005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179bcec-1a79-417b-aca5-f08664a6f69e None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.848179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 577/1135] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:12.856937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.857739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.857897 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.878132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:12.879358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:12.957928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 559/1136] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:13.232747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179bcec-1a79-417b-aca5-f08664a6f69e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.325285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.349940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179bcec-1a79-417b-aca5-f08664a6f69e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.389975 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be94ee-2476-48d6-9620-fd7dd1760701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.390635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be94ee-2476-48d6-9620-fd7dd1760701 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.390916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be94ee-2476-48d6-9620-fd7dd1760701 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.391188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be94ee-2476-48d6-9620-fd7dd1760701 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.392470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be94ee-2476-48d6-9620-fd7dd1760701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.393938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be94ee-2476-48d6-9620-fd7dd1760701 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.395610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 578/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.401734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.450569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.517896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af3af4-5c07-4f72-a15a-97b12579c9b9 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.556433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15bf00-5852-4d6d-a0dc-888b5cb58b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.557057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15bf00-5852-4d6d-a0dc-888b5cb58b06 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.557341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15bf00-5852-4d6d-a0dc-888b5cb58b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.557612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15bf00-5852-4d6d-a0dc-888b5cb58b06 None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.558290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15bf00-5852-4d6d-a0dc-888b5cb58b06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.559761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15bf00-5852-4d6d-a0dc-888b5cb58b06 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.587163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 560/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:13 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:16.062852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c5d3-f071-4124-b0e3-527fffed88ba None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.063412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c5d3-f071-4124-b0e3-527fffed88ba None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.063412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c5d3-f071-4124-b0e3-527fffed88ba None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.064770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 579/1139] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:16.070852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf451-acdd-455b-a509-fc181c971871 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.071417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf451-acdd-455b-a509-fc181c971871 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.071417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf451-acdd-455b-a509-fc181c971871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.091225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-27daf451-acdd-455b-a509-fc181c971871 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:16.093403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-27daf451-acdd-455b-a509-fc181c971871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:16.170734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 561/1140] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:16.448902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c5d3-f071-4124-b0e3-527fffed88ba None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.565554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c5d3-f071-4124-b0e3-527fffed88ba None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.604325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.604965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.605241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.605505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.617630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:16.622453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:16.624232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:35:16.626033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 580/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:16.630938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daf451-acdd-455b-a509-fc181c971871 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.682294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.815604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daf451-acdd-455b-a509-fc181c971871 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:16.861830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:16.862453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.862729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.862997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.863677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:16.863981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:16.865407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:16.874845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 562/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.881097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:16.896308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.996044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d34252-aabd-4af7-8442-a25af4b1bbe7 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.035362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.036010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.036316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.036590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] PATH_INFO: `/v3/users/5d8c8cb70f95429f9160ff1ef8046492` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.052735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] RBAC: Authorizing `identity:get_user(user_id=5d8c8cb70f95429f9160ff1ef8046492)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.054269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.056098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 581/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:16 2022] GET /identity/v3/users/5d8c8cb70f95429f9160ff1ef8046492 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.063201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.169352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.180764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775913-53c8-478b-bfda-2eb5a80e5bc8 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.220533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.221258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.221594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.221915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.305920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.307567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.415601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.432493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 563/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:35:17.438820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.519118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.557748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc9b0-5995-48ec-8c2f-d49f00b32582 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.594706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea480d54-e7f4-49cb-b451-94b3e8906fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.595349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea480d54-e7f4-49cb-b451-94b3e8906fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.595624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea480d54-e7f4-49cb-b451-94b3e8906fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.595893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea480d54-e7f4-49cb-b451-94b3e8906fd6 None admin] PATH_INFO: `/v3/projects/90f9be9187fe49f480565c60d0b4ac7d` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.597090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea480d54-e7f4-49cb-b451-94b3e8906fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=90f9be9187fe49f480565c60d0b4ac7d)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.598539 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea480d54-e7f4-49cb-b451-94b3e8906fd6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.600223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 582/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/projects/90f9be9187fe49f480565c60d0b4ac7d => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.611179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.724938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fffb9-4d5a-4418-b219-536c93a5bbf5 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.761925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.762541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.762817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.763252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.764106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=90f9be9187fe49f480565c60d0b4ac7d, user.id=5d8c8cb70f95429f9160ff1ef8046492) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:17.764450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.765915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead54ca-4249-46bc-bc08-93a5434a3a5b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.772005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 564/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/role_assignments?user.id=5d8c8cb70f95429f9160ff1ef8046492&scope.project.id=90f9be9187fe49f480565c60d0b4ac7d&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:20.010626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54022a8-2184-4190-8971-a1df56eee26c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.011311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54022a8-2184-4190-8971-a1df56eee26c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.011311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54022a8-2184-4190-8971-a1df56eee26c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.012661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 583/1147] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:20.023718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.024337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.024337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.044601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:20.046334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:20.107272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:20.127611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 565/1148] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:20.398724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54022a8-2184-4190-8971-a1df56eee26c None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.522678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54022a8-2184-4190-8971-a1df56eee26c None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.563320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.563976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.564308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.564567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.567794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:20.578584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:20.583534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:20.585360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:35:20.587022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 584/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:20.591095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.705590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a5a66-a863-48c0-adb1-03d019fc273d None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.744475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.745112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.745395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.745678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.746364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:20.746672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.749079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.758828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 566/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:20.766068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:20.911846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998e5a6-78f3-4677-b454-4143e090210f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:20.950268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:20.950987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.951271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.951543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] PATH_INFO: `/v3/users/5d8c8cb70f95429f9160ff1ef8046492` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.952822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] RBAC: Authorizing `identity:get_user(user_id=5d8c8cb70f95429f9160ff1ef8046492)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:20.954295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:20.956020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 585/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/users/5d8c8cb70f95429f9160ff1ef8046492 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:20.962226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.018183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.079720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fd01f-f7d2-401f-a754-9b495c9d97a2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.120018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4aeb8-f8f4-4da5-a572-ddedcfe3e844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.120830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4aeb8-f8f4-4da5-a572-ddedcfe3e844 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.121109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4aeb8-f8f4-4da5-a572-ddedcfe3e844 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.121381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4aeb8-f8f4-4da5-a572-ddedcfe3e844 None admin] PATH_INFO: `/v3/projects/90f9be9187fe49f480565c60d0b4ac7d` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.122949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4aeb8-f8f4-4da5-a572-ddedcfe3e844 None admin] RBAC: Authorizing `identity:get_project(project_id=90f9be9187fe49f480565c60d0b4ac7d)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.124166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4aeb8-f8f4-4da5-a572-ddedcfe3e844 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.125932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 567/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:20 2022] GET /identity/v3/projects/90f9be9187fe49f480565c60d0b4ac7d => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:21.132433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.210522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.257677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948f407-8dba-4179-884a-42c50e755990 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.298195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae03d8-1826-4bd2-8481-5214015adce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.298882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae03d8-1826-4bd2-8481-5214015adce0 None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.299159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae03d8-1826-4bd2-8481-5214015adce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.299431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae03d8-1826-4bd2-8481-5214015adce0 None admin] PATH_INFO: `/v3/projects/90f9be9187fe49f480565c60d0b4ac7d/users/5d8c8cb70f95429f9160ff1ef8046492/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.301414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae03d8-1826-4bd2-8481-5214015adce0 None admin] RBAC: Authorizing `identity:create_grant(project_id=90f9be9187fe49f480565c60d0b4ac7d, user_id=5d8c8cb70f95429f9160ff1ef8046492, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.302893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae03d8-1826-4bd2-8481-5214015adce0 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.318694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 586/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:21 2022] PUT /identity/v3/projects/90f9be9187fe49f480565c60d0b4ac7d/users/5d8c8cb70f95429f9160ff1ef8046492/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:23.577552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f5e0-f820-4501-90a6-77bd380bebdd None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.578168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f5e0-f820-4501-90a6-77bd380bebdd None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.578168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f5e0-f820-4501-90a6-77bd380bebdd None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.579499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 568/1154] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:23.585758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.586348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.586348 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.606498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:23.608502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:23.683351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 587/1155] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:23.955543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f5e0-f820-4501-90a6-77bd380bebdd None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.071859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f5e0-f820-4501-90a6-77bd380bebdd None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.087301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.111397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.112127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.112435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.112720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.124904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:24.129769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:24.131045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:24.132102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:35:24.136444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 569/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:24.138746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.209718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.265195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768ef1-3f60-4896-a223-4566c0962a30 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.303976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.304728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.305017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.305291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.305982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:24.306289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.307691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.317297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 588/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.328844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.487320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f4c7f-d7e6-42b1-8a56-6385eabcfcd1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.526560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.527232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.527538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.527816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] PATH_INFO: `/v3/users/5d8c8cb70f95429f9160ff1ef8046492` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.529679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] RBAC: Authorizing `identity:get_user(user_id=5d8c8cb70f95429f9160ff1ef8046492)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.531351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.533069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 570/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/users/5d8c8cb70f95429f9160ff1ef8046492 => generated 286 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.539295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.652064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc26fca-7362-410a-924b-82024420ca96 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.671141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.690901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.691512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.691791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.692061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.768620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.770008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.878350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 589/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:24.885011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.934698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.999537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908a369-c144-4a17-bb2e-cfce4bf24b68 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.039284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e05c5-6f5c-4463-9d3e-b2c7a4221be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.039843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e05c5-6f5c-4463-9d3e-b2c7a4221be3 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.040127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e05c5-6f5c-4463-9d3e-b2c7a4221be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.040526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e05c5-6f5c-4463-9d3e-b2c7a4221be3 None admin] PATH_INFO: `/v3/projects/90f9be9187fe49f480565c60d0b4ac7d` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.041689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e05c5-6f5c-4463-9d3e-b2c7a4221be3 None admin] RBAC: Authorizing `identity:get_project(project_id=90f9be9187fe49f480565c60d0b4ac7d)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.043156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e05c5-6f5c-4463-9d3e-b2c7a4221be3 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.045531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 571/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/projects/90f9be9187fe49f480565c60d0b4ac7d => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:25.052977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.072671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.164717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a21d-179a-4096-8ba5-7f2ef26b0886 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.205168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.205834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.206140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.206449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.207217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=90f9be9187fe49f480565c60d0b4ac7d, user.id=5d8c8cb70f95429f9160ff1ef8046492) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.207527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.209156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb7b69-e6fb-4e81-b60d-e7e7d339a94d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.216398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 590/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/role_assignments?user.id=5d8c8cb70f95429f9160ff1ef8046492&scope.project.id=90f9be9187fe49f480565c60d0b4ac7d&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:27.514305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a8c31-021f-4054-8a35-7ffd3a098849 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.515139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a8c31-021f-4054-8a35-7ffd3a098849 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.515342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a8c31-021f-4054-8a35-7ffd3a098849 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.517920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 572/1162] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:27.524549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.525195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.525195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.547379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:27.548696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:27.624079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 591/1163] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:27.903254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a8c31-021f-4054-8a35-7ffd3a098849 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.021411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a8c31-021f-4054-8a35-7ffd3a098849 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.034417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.062239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.062913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.063196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.063470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.142675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.144162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.260605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 573/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:35:28.270364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.284059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.386465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524593-396f-4b1c-9e09-b46a87372532 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.425346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.426006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.426281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.426554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.434377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.436693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-48e57895-1995-4586-934f-4d8b2d15e220 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:28.449907 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:28.452068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:35:28.454035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 592/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:28.459999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.475026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.593421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e8169-56fe-4bbe-9f49-173d11f3adfb None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.649164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.650178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.650661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.651120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.652289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:28.652814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.655968 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ccf21-cbf3-409c-a8f6-f437035f0ff0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.668279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 574/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.974530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17611-a0b8-4ddd-9023-565d078e4452 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.975206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17611-a0b8-4ddd-9023-565d078e4452 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.975206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc17611-a0b8-4ddd-9023-565d078e4452 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.976468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 593/1167] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:30.983865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731115-ddeb-45fb-9e38-bf0046117241 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.983865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731115-ddeb-45fb-9e38-bf0046117241 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.984911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731115-ddeb-45fb-9e38-bf0046117241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.003742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-99731115-ddeb-45fb-9e38-bf0046117241 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:31.005007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-99731115-ddeb-45fb-9e38-bf0046117241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:31.082869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 575/1168] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:31.366084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17611-a0b8-4ddd-9023-565d078e4452 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.455488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.490066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc17611-a0b8-4ddd-9023-565d078e4452 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.527476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244965a-ecd2-4975-b191-f63a25002aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.528233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244965a-ecd2-4975-b191-f63a25002aed None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.528657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244965a-ecd2-4975-b191-f63a25002aed None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.529547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244965a-ecd2-4975-b191-f63a25002aed None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.530238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244965a-ecd2-4975-b191-f63a25002aed None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.531639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244965a-ecd2-4975-b191-f63a25002aed None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.552791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 594/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Fri Oct 28 09:35:31 2022] POST /identity/v3/domains => generated 267 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:34.073759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1404a-0a29-4046-af3d-b736859b47b1 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.074355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1404a-0a29-4046-af3d-b736859b47b1 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.074355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1404a-0a29-4046-af3d-b736859b47b1 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.075689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 576/1170] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:34.082675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.083243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.083410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.103888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:34.105197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:34.184015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 595/1171] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:34.477836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1404a-0a29-4046-af3d-b736859b47b1 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.481928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.596268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1404a-0a29-4046-af3d-b736859b47b1 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.634824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a242-cdf7-421a-8ab1-f676d659524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.635390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a242-cdf7-421a-8ab1-f676d659524a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.635671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a242-cdf7-421a-8ab1-f676d659524a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.635947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a242-cdf7-421a-8ab1-f676d659524a None admin] PATH_INFO: `/v3/domains/3846b3c5a9fd498fb4a19b7a92e12f72` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.649174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a242-cdf7-421a-8ab1-f676d659524a None admin] RBAC: Authorizing `identity:get_domain(domain_id=3846b3c5a9fd498fb4a19b7a92e12f72)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.651517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a242-cdf7-421a-8ab1-f676d659524a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.653648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 577/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Fri Oct 28 09:35:34 2022] GET /identity/v3/domains/3846b3c5a9fd498fb4a19b7a92e12f72 => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:34.659859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:34.729802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:34.778236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d41bf-ade6-4a63-8354-d42dfbe1b794 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:34.819014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85b56-1719-4537-b7e7-22c40e88f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:34.819635 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85b56-1719-4537-b7e7-22c40e88f144 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:34.819906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85b56-1719-4537-b7e7-22c40e88f144 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:34.820170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85b56-1719-4537-b7e7-22c40e88f144 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:34.820868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe85b56-1719-4537-b7e7-22c40e88f144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:34.822307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe85b56-1719-4537-b7e7-22c40e88f144 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:34.852772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 596/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:34 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:35:37.259533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5af6c6-155d-4e82-8a3e-9776e226f238 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.260146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5af6c6-155d-4e82-8a3e-9776e226f238 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.260146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5af6c6-155d-4e82-8a3e-9776e226f238 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.261655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 578/1174] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:37.267789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.268395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.268395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.288451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:37.289709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:37.363190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 597/1175] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:37.637188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5af6c6-155d-4e82-8a3e-9776e226f238 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.714768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.767133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5af6c6-155d-4e82-8a3e-9776e226f238 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.809090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b5442-ede1-406a-88e3-a928702775eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.809822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5442-ede1-406a-88e3-a928702775eb None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.810133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5442-ede1-406a-88e3-a928702775eb None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.810554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5442-ede1-406a-88e3-a928702775eb None admin] PATH_INFO: `/v3/domains/3846b3c5a9fd498fb4a19b7a92e12f72` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.812137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b5442-ede1-406a-88e3-a928702775eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=3846b3c5a9fd498fb4a19b7a92e12f72)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.813757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b5442-ede1-406a-88e3-a928702775eb None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.815400 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 579/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/domains/3846b3c5a9fd498fb4a19b7a92e12f72 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:37.821688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.872016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.946093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058470e-eff5-450d-a866-6cbe5a7a1ce0 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.987845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0b059-159d-4568-b6c5-85b42bfa8562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.988763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0b059-159d-4568-b6c5-85b42bfa8562 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.989098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0b059-159d-4568-b6c5-85b42bfa8562 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.989412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0b059-159d-4568-b6c5-85b42bfa8562 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.990355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0b059-159d-4568-b6c5-85b42bfa8562 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.992063 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0b059-159d-4568-b6c5-85b42bfa8562 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.019253 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 598/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:37 2022] POST /identity/v3/users => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:35:40.387445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb643-cf7f-48ad-974d-86de4ff1a719 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.388052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb643-cf7f-48ad-974d-86de4ff1a719 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.388052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb643-cf7f-48ad-974d-86de4ff1a719 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.389482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 580/1178] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:40.395556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.396147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.396147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.417105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:40.418326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:40.534755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 599/1179] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:40.834226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cb643-cf7f-48ad-974d-86de4ff1a719 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.954665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cb643-cf7f-48ad-974d-86de4ff1a719 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.989943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.995800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.996480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.996766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.997044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.010225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:41.015415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:41.017395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:35:41.019141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 581/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:41.024693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.056710 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.143197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e130157-3927-41d2-90dc-80e2a2397251 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.183278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.183942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.184208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.184513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.185997 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:41.186310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.187912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.198904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 600/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:41.205690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.320336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b092-1ff0-4833-9296-ea6288dc4a53 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.359236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.359901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.360182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.360504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] PATH_INFO: `/v3/users/30ca40d51f3d4397907d1b800e19f204` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.376853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] RBAC: Authorizing `identity:get_user(user_id=30ca40d51f3d4397907d1b800e19f204)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.378470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.380230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 582/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/users/30ca40d51f3d4397907d1b800e19f204 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:41.386330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.526128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.537738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ddbaa-d103-4e51-a74e-9c4513cf7e3b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.578644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.579274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.579557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.579835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.660088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.661712 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.768581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.782625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 601/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:35:41.789076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.848630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.910045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c239a6-cfd6-4322-a28c-19fb42da8925 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.949666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5912f-8edc-4688-adb8-53b3e0c1542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.950364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5912f-8edc-4688-adb8-53b3e0c1542d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.950689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5912f-8edc-4688-adb8-53b3e0c1542d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.951009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5912f-8edc-4688-adb8-53b3e0c1542d None admin] PATH_INFO: `/v3/projects/934d084334574c70beb6e69514fe13c6` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.952868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5912f-8edc-4688-adb8-53b3e0c1542d None admin] RBAC: Authorizing `identity:get_project(project_id=934d084334574c70beb6e69514fe13c6)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.954395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5912f-8edc-4688-adb8-53b3e0c1542d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.956185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 583/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/projects/934d084334574c70beb6e69514fe13c6 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:41.962871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.073272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc9e4f-2741-4945-bb3c-b66247ce29ba None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.111471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.112090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.112401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.112677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.113423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=934d084334574c70beb6e69514fe13c6, user.id=30ca40d51f3d4397907d1b800e19f204) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:42.113737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.115183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee8193-8de5-4215-bcff-ba9149355b57 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.121372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 602/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/role_assignments?user.id=30ca40d51f3d4397907d1b800e19f204&scope.project.id=934d084334574c70beb6e69514fe13c6&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.375775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86145-db51-469a-8c4d-d126bb9f223d None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.376372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86145-db51-469a-8c4d-d126bb9f223d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.376372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c86145-db51-469a-8c4d-d126bb9f223d None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.377781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 584/1186] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:44.384375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.384940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.385054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.405881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:44.407092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:44.469969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.491923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 603/1187] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:35:44.767795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c86145-db51-469a-8c4d-d126bb9f223d None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.886717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c86145-db51-469a-8c4d-d126bb9f223d None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.907795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.926507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.927157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.927446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.927718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.940374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:44.945283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:44.946949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:35:44.947798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 585/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:44.957735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.149675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78410cc-e2be-4ff1-a0b1-7066ebf82fa1 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.223274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.224543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.225102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.225686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.227499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:45.228270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.231861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.250705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 604/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:45.257191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.372129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb76fc-b95c-49a7-b0d4-a4f334b53f2d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.413295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.413979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.414102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.414379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] PATH_INFO: `/v3/users/30ca40d51f3d4397907d1b800e19f204` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.415595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=30ca40d51f3d4397907d1b800e19f204)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.417149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.418898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 586/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:45 2022] GET /identity/v3/users/30ca40d51f3d4397907d1b800e19f204 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:45.426637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.480523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.540509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef61c5-25ac-453a-85b0-c74c5bd3f7aa None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.589363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e156f43-850b-46c6-a59d-fd374d81eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.590269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e156f43-850b-46c6-a59d-fd374d81eab6 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.590667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e156f43-850b-46c6-a59d-fd374d81eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.591074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e156f43-850b-46c6-a59d-fd374d81eab6 None admin] PATH_INFO: `/v3/projects/934d084334574c70beb6e69514fe13c6` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.593739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e156f43-850b-46c6-a59d-fd374d81eab6 None admin] RBAC: Authorizing `identity:get_project(project_id=934d084334574c70beb6e69514fe13c6)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.595936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e156f43-850b-46c6-a59d-fd374d81eab6 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.598913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 605/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:45 2022] GET /identity/v3/projects/934d084334574c70beb6e69514fe13c6 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:45.605102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.659847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.721807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4fcb3-2ffc-4e17-afde-e03f8da2a4b1 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.762290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4df13-37d0-4881-b930-a9e7ab880222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.763056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4df13-37d0-4881-b930-a9e7ab880222 None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.763384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4df13-37d0-4881-b930-a9e7ab880222 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.763741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4df13-37d0-4881-b930-a9e7ab880222 None admin] PATH_INFO: `/v3/projects/934d084334574c70beb6e69514fe13c6/users/30ca40d51f3d4397907d1b800e19f204/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.766106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4df13-37d0-4881-b930-a9e7ab880222 None admin] RBAC: Authorizing `identity:create_grant(project_id=934d084334574c70beb6e69514fe13c6, user_id=30ca40d51f3d4397907d1b800e19f204, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.767672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4df13-37d0-4881-b930-a9e7ab880222 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.786694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 587/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:45 2022] PUT /identity/v3/projects/934d084334574c70beb6e69514fe13c6/users/30ca40d51f3d4397907d1b800e19f204/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:48.055918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43ce1-8acf-4a91-b69f-44b5db77d660 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.056687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43ce1-8acf-4a91-b69f-44b5db77d660 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.056687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43ce1-8acf-4a91-b69f-44b5db77d660 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.057984 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 606/1193] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:48.064853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.065626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.065816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.086202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:48.087417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:48.168930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 588/1194] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:35:48.449956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b43ce1-8acf-4a91-b69f-44b5db77d660 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.566841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b43ce1-8acf-4a91-b69f-44b5db77d660 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.584091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.609557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.610210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.610489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.610762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.623633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:48.628908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:48.630795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:35:48.632466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 607/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:48.636713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.675822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.756630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21bd11-2b7e-4e17-ad7d-d9ea93e46008 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.796360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.796998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.797546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.797824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.798533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.798844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.800700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.809829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 589/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:48.817581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.965446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9015571-3dd0-414e-a821-c745c519a44e None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.028138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.029231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.029834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.030333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] PATH_INFO: `/v3/users/30ca40d51f3d4397907d1b800e19f204` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.032451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] RBAC: Authorizing `identity:get_user(user_id=30ca40d51f3d4397907d1b800e19f204)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.035147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.038266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 608/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/users/30ca40d51f3d4397907d1b800e19f204 => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:49.044160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.156150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.161345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f61ee-4c34-452d-a9b2-dafd9f5665bc None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.204570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.205285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.205602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.205919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.287963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.289388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.421506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.430006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 590/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:35:49.436868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.516343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.620386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48082bf-c088-4efc-b7b1-9e103331ac5c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.677743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969899e-b314-4b71-8a35-91b686dab8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.678723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969899e-b314-4b71-8a35-91b686dab8cc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.679167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969899e-b314-4b71-8a35-91b686dab8cc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.679584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969899e-b314-4b71-8a35-91b686dab8cc None admin] PATH_INFO: `/v3/projects/934d084334574c70beb6e69514fe13c6` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.681459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969899e-b314-4b71-8a35-91b686dab8cc None admin] RBAC: Authorizing `identity:get_project(project_id=934d084334574c70beb6e69514fe13c6)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.684024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969899e-b314-4b71-8a35-91b686dab8cc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.687256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 609/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/projects/934d084334574c70beb6e69514fe13c6 => generated 361 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:49.693409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.812037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b96b7f-0b5d-4142-952f-0c9d8e9a9145 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.851745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.852406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.852691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.852967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.853715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=934d084334574c70beb6e69514fe13c6, user.id=30ca40d51f3d4397907d1b800e19f204) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:49.854031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.855516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdfe16-63b8-4014-8c67-4244c4f519c0 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.863179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 591/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/role_assignments?user.id=30ca40d51f3d4397907d1b800e19f204&scope.project.id=934d084334574c70beb6e69514fe13c6&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:59.670797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=45 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.860105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=69 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.401738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d07eb1-dcf7-473e-8d8c-c76aeb6578fe None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.402626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d07eb1-dcf7-473e-8d8c-c76aeb6578fe None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.402626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d07eb1-dcf7-473e-8d8c-c76aeb6578fe None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.403700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 610/1201] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:53.416131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.416131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.416131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.444163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:53.446444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:53.580234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 592/1202] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:53.864788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d07eb1-dcf7-473e-8d8c-c76aeb6578fe None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.071434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d07eb1-dcf7-473e-8d8c-c76aeb6578fe None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.159168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.160139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.165502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.166202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.193837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.196727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:54.232507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:54.235162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:54.238181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:54.238181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:54.238181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:36:54.238181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 611/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:54.245619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.474808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66e11-af08-46af-a74d-16a38c0d8450 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.538775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.551823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.553131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.556413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.556982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.558141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:54.558699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.561382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a757a-86d0-43d4-8554-e4c742915d2d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.592307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 593/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:54.595170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.716155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.793239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8d226-e465-481f-b6e1-e899575edb93 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.855580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b376c-11e4-43f0-8072-9ccbb5da5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.856668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b376c-11e4-43f0-8072-9ccbb5da5f9d None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.857154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b376c-11e4-43f0-8072-9ccbb5da5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.857631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b376c-11e4-43f0-8072-9ccbb5da5f9d None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.858840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b376c-11e4-43f0-8072-9ccbb5da5f9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.862371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b376c-11e4-43f0-8072-9ccbb5da5f9d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.906605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 612/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Fri Oct 28 09:36:54 2022] POST /identity/v3/users => generated 251 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:58.263584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84596-98aa-4f05-8f8a-877fd147092a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.264518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84596-98aa-4f05-8f8a-877fd147092a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.264730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84596-98aa-4f05-8f8a-877fd147092a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.268125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 594/1206] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:36:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:58.277467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9826-c744-485c-8665-baeb8894810b None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.278049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9826-c744-485c-8665-baeb8894810b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.278431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9826-c744-485c-8665-baeb8894810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.310193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-acee9826-c744-485c-8665-baeb8894810b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:58.312217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-acee9826-c744-485c-8665-baeb8894810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:58.458585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 613/1207] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:58.952453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d84596-98aa-4f05-8f8a-877fd147092a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:59.151379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d84596-98aa-4f05-8f8a-877fd147092a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:59.209434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:59.210263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.210733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.211215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.232280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:59.240334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:59.242426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:59.244077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:36:59.247440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 595/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:59.254925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9826-c744-485c-8665-baeb8894810b None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:59.308629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:59.424038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9826-c744-485c-8665-baeb8894810b None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:59.490526 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:59.491109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.491480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.491840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.495718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:59.495718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:59.495718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:59.510979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 614/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:59.513100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:59.585515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:59.664589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d313d-c2b4-4de5-b1e9-683aa96a0d10 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:59.718849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:59.719965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.720417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.720909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.746726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:59.749364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:59.783461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:59.784723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:59.785702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:59.785702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:59.785702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:36:59.792293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 596/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:59.795680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:59.975970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:59.981077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c4ef8-60c3-44fe-8ea9-7f43a8eeb0fc None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.051438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.052453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.053023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.053268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.054167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:00.054415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.056019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.074993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 615/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:00.081501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.250069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a205111-deb6-4c29-950f-d50c6db95a24 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.254028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:00.315316 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.316167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.316546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.317158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.329690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.332601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:00.356300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:00.358734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:00.361362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:00.366064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 597/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:00.376134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.582305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73512086-5abc-4802-b10c-b8defb6eae9b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.651163 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.652844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.653550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.654392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.657305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:00.657850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.660619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.703404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 616/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:00.711682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.913722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42da17-b434-4bbc-8e08-a8eb208d086e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.986651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.988332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.988993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.989747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:01.036630 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:01.103351 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:01.105458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:01.312430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 598/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:01.319955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:01.354686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:01.546826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319059bb-36c1-48a7-934f-0746333768cb None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:01.621441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:01.623025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:01.623812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:01.624661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:01.648193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:01.651355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:01.677504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:01.679683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:01.682151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:01.682151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:01.682151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:01.682151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 617/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:01.692132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:01.817372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:01.905530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4b95-c5c8-416b-b5ba-f0d95380de57 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:01.958784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:01.959517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:01.960693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:01.960693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:01.961007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:01.961194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:01.968384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:01.985726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 599/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:01.989770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:02.149583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:02.212297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5426a3d-ccdd-4bf1-b272-1ce3743835ea None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:02.291833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:02.293076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:02.293648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:02.294199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:02.310372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:02.312008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:02.335417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:02.337478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:02.349026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 618/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:02.351105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:02.533288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dde85-4d07-4329-8adb-990213bb643f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:02.562148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:02.579243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:02.579901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:02.580313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:02.580504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:02.581416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:02.581708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:02.583580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879eab30-7ece-46e6-9164-20d02d3282f7 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:02.600843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 600/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:02.608143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:02.738524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c74af-15ca-4964-9796-ec92a35d8c4c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:02.774570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:02.782943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844427b3-4513-4758-9cab-92be04203338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:02.783698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844427b3-4513-4758-9cab-92be04203338 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:02.784438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844427b3-4513-4758-9cab-92be04203338 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:02.784810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844427b3-4513-4758-9cab-92be04203338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:02.786159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844427b3-4513-4758-9cab-92be04203338 None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=c8de1fbeee81475297d46258d7569b02) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:02.786620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844427b3-4513-4758-9cab-92be04203338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:02.788571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844427b3-4513-4758-9cab-92be04203338 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:02.796762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 619/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:02 2022] GET /identity/v3/role_assignments?user.id=c8de1fbeee81475297d46258d7569b02&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:05.542370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded46f0-5ae2-43f1-818c-4ce54f8cd0b1 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.543242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded46f0-5ae2-43f1-818c-4ce54f8cd0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.543412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded46f0-5ae2-43f1-818c-4ce54f8cd0b1 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.545829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 601/1220] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:05.554219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.555144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.555144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.581332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:05.583334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:05.691297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 620/1221] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:05.982073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded46f0-5ae2-43f1-818c-4ce54f8cd0b1 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.146925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded46f0-5ae2-43f1-818c-4ce54f8cd0b1 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.197421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.198260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.198636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.199009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.213738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:06.218964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:06.222528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:06.224207 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 602/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:37:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:06.229099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.419096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39176f5-eeda-4404-89c0-3e16dc660ac9 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.460864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.479489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.480640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.481177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.481617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.482485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] RBAC: Adding query filter params (name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:06.482894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.484505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.509383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 621/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:06.511767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.573310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.657132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5abbf6-f292-4acf-b4f0-d86033c60852 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.702193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.702888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.703191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.704036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.718297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.719945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:06.747837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:06.750073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:06.752310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:06.752310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:06.752310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:06.752310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 603/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:06.758436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.904564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee09f32-a7ba-432b-9192-1985b0e6b957 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.951954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.952697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.953104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.954523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.955721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:06.956275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.958517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.978730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 622/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:06.986573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.120284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.132284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b5c5-49dd-41ee-84e5-c52ef66f8a11 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.182876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.183620 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.183967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.184775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.196576 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.198471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:07.214352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:07.215406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:07.216420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 604/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:07.222817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.282107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.370009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c2ae8-ddb9-4276-9c07-d379111ce35b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.434426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.435167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.435638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.436068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.437388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:07.438414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.440950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.472036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 623/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:07.480668 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.639311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567070bc-779e-498d-bd73-17cbe5f41797 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.691713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.692429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.692713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.692987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.709295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.711240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:07.733399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:07.735998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:07.738895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:07.738895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:07.738895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:07.738895 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 605/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:07.742129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.913732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de76c35-fdf9-462f-8e3c-0708526974ab None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.917032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.971303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.972532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.973028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.973491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.974703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:07.975331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.978181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.999453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 624/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:08.006807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.023331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:08.170664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f1db1-64ef-4322-8e1c-b8e847d67dc6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.223951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.224994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.225468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.225859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.236360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.238401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:08.252931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:08.254219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:08.256739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 606/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:08.262405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.416535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632dd99-639e-4276-8e96-0bcdec0dea6b None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.479738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.480441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.480697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.480972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.481896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:08.482416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.484140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f930d-4614-4878-96d5-4105d5a20841 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.501373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 625/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:08.509358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.632523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:08.713227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b24e-d8eb-40c5-9c75-01f106e4e4e2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.777768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328af16e-5082-4a55-8f92-a552c2b3e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.778374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328af16e-5082-4a55-8f92-a552c2b3e46a None admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.778760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328af16e-5082-4a55-8f92-a552c2b3e46a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.779151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328af16e-5082-4a55-8f92-a552c2b3e46a None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/c8de1fbeee81475297d46258d7569b02/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.802810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328af16e-5082-4a55-8f92-a552c2b3e46a None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=c8de1fbeee81475297d46258d7569b02, role_id=b2f2870a6ae248cea4dc9cb6e23c5ac7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.804837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328af16e-5082-4a55-8f92-a552c2b3e46a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.822745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 607/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:08 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/c8de1fbeee81475297d46258d7569b02/roles/b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:37:11.633480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1525-bb4d-4ff4-a31c-babecbdeddb1 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:11.634323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1525-bb4d-4ff4-a31c-babecbdeddb1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:11.634323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1525-bb4d-4ff4-a31c-babecbdeddb1 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:11.636195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 626/1233] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:11.645778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:11.646489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:11.646489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:11.675329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:11.677686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:11.795787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 608/1234] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:12.126230 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1525-bb4d-4ff4-a31c-babecbdeddb1 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:12.159578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:12.288729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1525-bb4d-4ff4-a31c-babecbdeddb1 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:12.366685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:12.366901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:12.367290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:12.367732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:12.384611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:12.393313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:12.395268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:12.397512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 627/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Fri Oct 28 09:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:12.402532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:12.464783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:12.543039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bba816-f41a-49ad-a2db-c5774f156c4d None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:12.596029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:12.596784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:12.597124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:12.597461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:12.598265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] RBAC: Adding query filter params (name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:12.598696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:12.601075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:12.612011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 609/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Fri Oct 28 09:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:12.621361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:12.752720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:12.775374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b838c-150f-4202-ad61-3571aa3487dd None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:12.838519 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:12.840037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:12.840780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:12.841271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:12.861465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:12.864741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:12.900819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:12.901903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:12.902808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:12.902808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:12.902808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:12.902808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 628/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:12.909722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.127259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd0d3b-d933-4b29-9a02-9858c3c89d37 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.147263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.186815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.187899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.188419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.188909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.190113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:13.190661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.193528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.217385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 610/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:13.224768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.421170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a725d8-361e-4402-b43c-4be998621f6f None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.477045 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.477729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.478004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.478279 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.482187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.489933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.492196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:13.510307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:13.512305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:13.514771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 629/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:13.522170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.684489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088704-e947-4ce4-a79e-6da8ecce0c4c None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.730062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.730743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.731014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.731377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.732168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:13.732655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.734577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.772288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 611/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:13.778364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.949413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9fad8-511d-4370-97e2-1ce9e7dde48d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.021372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.022524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.023323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.023627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.154931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.168487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.171383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.335910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 630/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:37:14.345127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.402774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.524871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9bed0-3fcf-4e95-84a8-cbd71d8f40ce None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.585880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.586602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.586841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.587110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.599905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.601459 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:14.618581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:14.620428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:14.622062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:14.622062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:14.622062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:14.622062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 612/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:14.629211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.779475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.790501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abf38f-ab92-4363-8f0c-c58db408e224 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.850568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.851485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.851954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.852452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.853648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:14.854285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.856824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.877779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 631/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:14.879908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:15.024612 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:15.067760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39856be-64af-49f5-8339-85f7d325ceb4 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:15.139476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:15.140381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:15.140852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:15.141821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:15.157951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:15.160452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:15.176874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:15.179393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:15.181501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 613/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:15.189430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:15.353293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db8841-1524-4c95-ba0b-bfe9a7490839 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:15.411195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:15.411988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:15.412497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:15.412987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:15.414204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:15.414658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:15.416306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1102-5ed6-4691-b20f-bd4768752715 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:15.435235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 632/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:15.442059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:15.629372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd20b63-3747-47e8-8cc9-2c9467725720 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:15.705110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:15.706215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:15.706872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:15.707233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:15.708179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] RBAC: Adding query filter params (role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7, scope.project.id=862360b634994703825014c6d7c129f0, user.id=c8de1fbeee81475297d46258d7569b02) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:15.708715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:15.710964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d81b9-e7c3-4f47-a328-22c706967bdd None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:15.722481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 614/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:15 2022] GET /identity/v3/role_assignments?user.id=c8de1fbeee81475297d46258d7569b02&scope.project.id=862360b634994703825014c6d7c129f0&role.id=b2f2870a6ae248cea4dc9cb6e23c5ac7 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:18.526760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1bc8a-15a1-468e-a2c0-32b1071ad4c2 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:18.527434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1bc8a-15a1-468e-a2c0-32b1071ad4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:18.527434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1bc8a-15a1-468e-a2c0-32b1071ad4c2 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:18.528836 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 633/1247] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:18.535781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431160-7224-4772-bb40-ff6503426f36 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:18.536726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431160-7224-4772-bb40-ff6503426f36 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:18.536726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431160-7224-4772-bb40-ff6503426f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:18.543875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:18.561438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-15431160-7224-4772-bb40-ff6503426f36 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:18.563919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-15431160-7224-4772-bb40-ff6503426f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:18.681154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 615/1248] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:19.175745 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1bc8a-15a1-468e-a2c0-32b1071ad4c2 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:19.204536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:19.346374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1bc8a-15a1-468e-a2c0-32b1071ad4c2 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:19.397238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:19.398515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:19.399031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:19.399698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:19.419727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:19.431167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:19.433483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:19.435387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 634/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:19.437543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15431160-7224-4772-bb40-ff6503426f36 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:19.615073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15431160-7224-4772-bb40-ff6503426f36 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:19.671194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:19.678770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:19.679619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:19.680075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:19.680525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:19.681434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:19.681876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:19.684495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:19.699289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 616/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:19.709969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:19.840512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:19.900339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adbdc-f5e7-4bad-8496-e76e37c9eec1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:19.957388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:19.958427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:19.958921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:19.959522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:19.975363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:19.977194 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:20.000813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:20.002915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:20.003946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:20.003946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:20.003946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:20.003946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 635/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:20.009708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.189307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c3085-1e9e-41d9-a4dd-32df8891882a None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:20.245158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:20.246076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.246600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.247165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.248303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:20.248876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:20.252420 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:20.272267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 617/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:20.278252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.427776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef794ec5-75c0-401e-af46-309464bf455d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:20.461959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:20.471720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:20.472425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.472702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.472969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] PATH_INFO: `/v3/users/placement` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.482408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:20.483873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:20.498176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:20.506552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:20.509862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 636/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:20.513864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.603491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:20.676108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb73c-39c6-41c1-884c-189aaa7c9b41 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:20.730156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:20.730844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.731126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.731425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.732219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:20.732567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:20.734156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:20.761683 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 618/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:20.770501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.950744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b6c7-3c09-4c76-879b-89672eb09dbe None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:21.004381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:21.005248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:21.005632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:21.006073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:21.118007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:21.135166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:21.137167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:21.312199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 637/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:21.321921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:21.497515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db33485-1efe-47d3-b8df-a8aaa47fc98e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:21.523327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:21.562441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:21.563524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:21.563993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:21.564460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:21.579815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:21.581617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:21.606468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:21.608662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:21.611025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:21.611025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:21.611025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:21.612471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 619/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:21.619192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:21.762762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:21.786644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1c66-d8df-448f-ae82-b8b0c12e0226 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:21.854280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:21.855298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:21.855772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:21.856276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:21.857447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:21.857979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:21.861137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:21.883554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 638/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:21.892186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:22.074093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70825-797a-4c56-961d-30c02b2b5097 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:22.133416 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:22.134292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:22.134753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:22.135213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:22.145549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:22.147541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:22.166080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:22.167338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:22.170164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 620/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:22.176478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:22.333100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc58a07-4274-42aa-ad1b-d4700a422626 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:22.387752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:22.388748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:22.389131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:22.389534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:22.390514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:22.390858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:22.393191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35025be-f98f-48c1-9cdf-5b7844a2bbc7 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:22.422039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 639/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:22.426534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:22.487241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:22.605028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea545acc-d5dd-4e99-9a2e-c201957c4d99 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:22.651084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:22.651845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:22.652211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:22.652631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:22.653531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=862360b634994703825014c6d7c129f0, user.id=c8de1fbeee81475297d46258d7569b02) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:22.653939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:22.655695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714471b-892b-48a8-9b60-3fe1e2a4d54e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:22.676277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 621/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:22 2022] GET /identity/v3/role_assignments?user.id=c8de1fbeee81475297d46258d7569b02&scope.project.id=862360b634994703825014c6d7c129f0&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:25.778372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458a2c-53ca-4bda-8fc2-7e0cbd3da927 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:25.778908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458a2c-53ca-4bda-8fc2-7e0cbd3da927 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:25.778908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458a2c-53ca-4bda-8fc2-7e0cbd3da927 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:25.780174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 640/1261] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:25.786208 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:25.786753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:25.786753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:25.807205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:25.808505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:25.884424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 622/1262] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:26.181607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e458a2c-53ca-4bda-8fc2-7e0cbd3da927 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:26.194758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:26.297853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e458a2c-53ca-4bda-8fc2-7e0cbd3da927 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:26.335891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:26.336574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:26.336855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:26.337125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:26.350093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:26.355169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:26.356387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:26.357295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 641/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:26.363022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:26.382059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:26.475591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7d6ea-f147-4401-b5be-eebaadbf5800 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:26.514633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:26.515262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:26.515545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:26.515816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:26.516713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:26.517016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:26.518512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:26.528461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 623/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:26.535374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:26.609382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:26.647343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648bab5-72ab-4c2e-835d-ac5511d7b948 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:26.685792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:26.686573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:26.686856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:26.687131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:26.699084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:26.700601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:26.718035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:26.719969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:26.722017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:26.722017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:26.722017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:26.722017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 642/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:26.725795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:26.817021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:26.838548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dbd83-33c4-4aea-98bc-da27b14233ce None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:26.877782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:26.878417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:26.878695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:26.878963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:26.879619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:26.879926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:26.881369 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:26.895141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 624/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:26.901322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.027291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128003e3-b3f6-433a-bfc7-59f358df6fe4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.052199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:27.070066 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.070862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.071236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.071513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.080581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.082076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:27.096554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:27.098512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:27.100296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 643/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:27.104137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.237520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928edef-6fa1-44cd-835e-4dc309074c8f None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.301592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.302587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.303339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.303841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.305299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:27.305855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.308628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.325638 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:27.347827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 625/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:27.354240 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.477818 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1698b-cef5-4ac0-b03d-b6346dab7a21 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.541623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.542684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.543177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.543680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.565755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.568580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:27.597866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:27.599190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:27.600360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:27.600360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:27.600360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:27.600360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 644/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:27.609589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.735928 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f372c-b69c-4bc0-9c3b-eda0271cb64e None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.777107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.777777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.778093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.778406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.779106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:27.779446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.780931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.794877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 626/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:27.803632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.841302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:27.931709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a110c-d102-4817-b6bf-a4c5ecbe409c None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.972447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.973147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.973467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.973787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.981771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.983233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:27.997320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:27.999368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:28.001285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 645/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:28.009758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:28.084550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:28.137025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdbab-5e9b-41ff-a729-c7740fb68151 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:28.176342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:28.177018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:28.177349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:28.177667 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:28.178700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:28.179053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:28.180609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac7270-f975-44c0-8dbe-6144f9008a20 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:28.195586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 627/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:28.206396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:28.316457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:28.327825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984f205-dd71-47cf-b2ef-64d590a0180d None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:28.370586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940fbe9-f686-4794-826c-ac97be088e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:28.371269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940fbe9-f686-4794-826c-ac97be088e1e None admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:28.371548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940fbe9-f686-4794-826c-ac97be088e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:28.371821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940fbe9-f686-4794-826c-ac97be088e1e None admin] PATH_INFO: `/v3/projects/862360b634994703825014c6d7c129f0/users/c8de1fbeee81475297d46258d7569b02/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:28.373844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940fbe9-f686-4794-826c-ac97be088e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=862360b634994703825014c6d7c129f0, user_id=c8de1fbeee81475297d46258d7569b02, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:28.375303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940fbe9-f686-4794-826c-ac97be088e1e None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:28.391727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 646/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:28 2022] PUT /identity/v3/projects/862360b634994703825014c6d7c129f0/users/c8de1fbeee81475297d46258d7569b02/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:37:31.165649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a168-6f40-435a-8bfc-cceca52b119b None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:31.166285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a168-6f40-435a-8bfc-cceca52b119b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:31.166285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a168-6f40-435a-8bfc-cceca52b119b None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:31.167689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 628/1274] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:31.173925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:31.174474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:31.174474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:31.194788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:31.196073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:31.276932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 647/1275] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:31.556718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a168-6f40-435a-8bfc-cceca52b119b None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:31.677237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a168-6f40-435a-8bfc-cceca52b119b None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:31.698693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:31.719228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:31.720568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:31.721053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:31.721545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:31.734174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:31.739808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:31.741577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:31.743421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 629/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:31.749340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:31.843162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:31.867490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7bee6-33c8-4f21-ba35-c944319280ab None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:31.906733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:31.907789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:31.908071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:31.908381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:31.909084 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:31.909391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:31.910804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:31.920757 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 648/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:31.928382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:32.055234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76439d3-c7d6-47bb-b4a1-ab6d391c6eba None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:32.106434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:32.107052 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.107328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.107597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:32.119384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:32.120921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:32.139474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:32.141636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:32.143893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:32.143893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:32.143893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:32.143893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 630/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:32.149658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:32.308234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119eb21-33b7-43a1-9951-0ca38f50b1b1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:32.345810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:32.346565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.346942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.347322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:32.348085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:32.348592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:32.350104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:32.365206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 649/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:32.374112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:32.413530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:32.499076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b802f-f99c-492d-8a34-aafc63c764f2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:32.539333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:32.539993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.540300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.540585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:32.550287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:32.551799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:32.565381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:32.567118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:32.568557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 631/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:32.574083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:32.578205 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:32.691133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ad4d5-fe28-4184-9971-c0a2581c5da1 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:32.731156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:32.731827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.732154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.732537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:32.733320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:32.733660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:32.735223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:32.755886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 650/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Fri Oct 28 09:37:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:32.762018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:32.869036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:32.881693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ff0ec-12ca-4e8c-96df-dbfae44e2a5b None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:32.921457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:32.922221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.922372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.922634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.005384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.006777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.108860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:33.122593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 632/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:33.128899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:33.200697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:33.244457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db12e67-42e8-447b-92e1-717b97741020 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:33.285013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:33.285566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:33.285844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:33.286113 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.297344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.299914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:33.317805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:33.320041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:33.321813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:33.321813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:33.321813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:33.321813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 651/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:33.326011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:33.444816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bd43e-0b85-43b6-8bc3-d3c3c1cea7a2 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:33.484012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:33.484660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:33.484938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:33.485206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.486581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:33.486886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.488307 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.501451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 633/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:33.508374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:33.675017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fe8fc-55bf-4901-947f-612c970a7c30 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:33.701940 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:33.740497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:33.741574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:33.742056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:33.742518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.751955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.753565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:33.766308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:33.767578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: ERROR keystone.server.flask.application Oct 28 09:37:33.769675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 652/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:33.774936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:33.835812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:33.896162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b653-01cb-456a-b32f-6ea58cd93252 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:33.935812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:33.936388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:33.936672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:33.936961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.937670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:33.937979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.939575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8c9a-82f4-4e96-aff2-61e9d9b2bca2 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.955643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 634/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:33.962301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:34.083402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e27c-1854-43a2-a416-3d36fb38b2c4 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:34.122482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:34.123108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:34.123389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:34.123663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:34.124467 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] RBAC: Adding query filter params (role.id=ffaa531437c44d74a7c49f5c86f516ca, scope.project.id=862360b634994703825014c6d7c129f0, user.id=c8de1fbeee81475297d46258d7569b02) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:34.124776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:34.126821 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ada390-f020-43f7-bf74-b463a48dc1ce None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:34.133592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 653/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:33 2022] GET /identity/v3/role_assignments?user.id=c8de1fbeee81475297d46258d7569b02&scope.project.id=862360b634994703825014c6d7c129f0&role.id=ffaa531437c44d74a7c49f5c86f516ca => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:36.467308 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481847b-936f-4661-a1d1-5331d12792c6 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.467862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481847b-936f-4661-a1d1-5331d12792c6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.467862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481847b-936f-4661-a1d1-5331d12792c6 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.469276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 635/1288] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:36.475711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.476280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.476445 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.496792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:36.498057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:36.533986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:36.578110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 654/1289] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:36.852619 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481847b-936f-4661-a1d1-5331d12792c6 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.968653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481847b-936f-4661-a1d1-5331d12792c6 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:36.981664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:37.015457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:37.016217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:37.016574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:37.017510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] PATH_INFO: `/v3/services/placement` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:37.018096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:37.019806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:37.031885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:37.033380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:37.034663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 636/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:37:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:37.044676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:37.171119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c2108-3916-441d-8746-23a956a0ceaa None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:37.211926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:37.212636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:37.212977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:37.213282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:37.214038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] RBAC: Adding query filter params (name=placement) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:37.214398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:37.215838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d1a48-5bd4-4cc1-bf99-b596b3977def None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:37.222214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 655/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Oct 28 09:37:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:37.230849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:37.351423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881d8f8-e7e7-4f85-9055-5a84223425af None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:37.391517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:37.392735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:37.393022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:37.393301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] PATH_INFO: `/v3/services` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:37.394056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:37.394367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:37.395846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f2fe-3525-4c37-92c5-550366ad1c85 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:37.401377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 637/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Oct 28 09:37:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:39.652120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9893-0f3d-4306-b067-ca378eee538a None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.652707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9893-0f3d-4306-b067-ca378eee538a None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.653076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9893-0f3d-4306-b067-ca378eee538a None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.654594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 656/1293] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:39.662037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194158-02aa-4aa4-8535-4306ea3cbe54 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.662600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194158-02aa-4aa4-8535-4306ea3cbe54 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.662600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194158-02aa-4aa4-8535-4306ea3cbe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.682958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-57194158-02aa-4aa4-8535-4306ea3cbe54 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:39.684187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-57194158-02aa-4aa4-8535-4306ea3cbe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:39.718088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:39.761760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 638/1294] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:40.278391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c9893-0f3d-4306-b067-ca378eee538a None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:40.316939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:40.401857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c9893-0f3d-4306-b067-ca378eee538a None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:40.444767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d0b61-605d-4273-ac3e-b56fb4dc3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:40.445533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0b61-605d-4273-ac3e-b56fb4dc3123 None admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:40.445898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0b61-605d-4273-ac3e-b56fb4dc3123 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:40.446262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d0b61-605d-4273-ac3e-b56fb4dc3123 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:40.447034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d0b61-605d-4273-ac3e-b56fb4dc3123 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:40.448737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d0b61-605d-4273-ac3e-b56fb4dc3123 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:40.467204 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 657/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Fri Oct 28 09:37:40 2022] POST /identity/v3/services => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:42.823395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5838ad6-5fce-4804-9a53-ec3eb14bafac None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:42.823981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5838ad6-5fce-4804-9a53-ec3eb14bafac None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:42.824161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5838ad6-5fce-4804-9a53-ec3eb14bafac None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:42.825676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 639/1296] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:42.832031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:42.832701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:42.832701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:42.853437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:42.854884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:42.943924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 658/1297] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:43.218819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5838ad6-5fce-4804-9a53-ec3eb14bafac None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.334660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5838ad6-5fce-4804-9a53-ec3eb14bafac None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.375853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.377023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.377464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.377947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.378621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.380008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:43.389462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:43.391290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:43.393341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 640/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:43.398360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.418978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.518415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c988c7-fd61-4935-b028-96d7c24404aa None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.558823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.559453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.559737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.560012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.560696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:43.561005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.562411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.569096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 659/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:43.579210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.642790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.775609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e58eda-fb1e-4db4-97c7-c482d5760f3d None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.837358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.838389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.838879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.839303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.840498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] RBAC: Adding query filter params (interface=public, service_id=08c015f868cf413ba9100fd2d7511d85, region_id=RegionOne) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:43.841009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.843407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f74f1-f842-48ab-b2bd-4e1d6f5c7033 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.853140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 641/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/endpoints?service_id=08c015f868cf413ba9100fd2d7511d85&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:43.859191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.958624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.979881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df96fc-21e5-46e3-af71-674982650221 None admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:44.021582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7190f-eab3-4b7b-bfe4-d693817cbbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:44.022206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7190f-eab3-4b7b-bfe4-d693817cbbea None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:44.022481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7190f-eab3-4b7b-bfe4-d693817cbbea None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:44.022755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7190f-eab3-4b7b-bfe4-d693817cbbea None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:44.023385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7190f-eab3-4b7b-bfe4-d693817cbbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:44.024825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7190f-eab3-4b7b-bfe4-d693817cbbea None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:44.032385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 660/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/services => generated 2191 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:37:46.589903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3f33e-4b41-438e-a06e-a396c99889bd None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:46.590632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3f33e-4b41-438e-a06e-a396c99889bd None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:46.590632 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3f33e-4b41-438e-a06e-a396c99889bd None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:46.592126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 642/1302] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:46.599116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:46.599842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:46.599842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:46.620881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:46.622058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:46.704079 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 661/1303] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:46.996896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3f33e-4b41-438e-a06e-a396c99889bd None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:47.108830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:47.117530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3f33e-4b41-438e-a06e-a396c99889bd None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:47.156335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:47.156982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:47.157259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:47.157527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:47.158802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:47.160567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:47.170129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:47.171998 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: ERROR keystone.server.flask.application Oct 28 09:37:47.174223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 643/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Fri Oct 28 09:37:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:47.180190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:47.269116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:47.296689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ee37-9785-4c8f-bfab-7952b6e6c5c8 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:47.337457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:47.338142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:47.338469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:47.338789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] PATH_INFO: `/v3/services` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:47.339492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:47.339845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:47.341390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234c5f9-89de-4aa3-a1e5-913648d6add4 None admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:47.348699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 662/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Fri Oct 28 09:37:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:47.354876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:47.474930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7690f-b4ba-4d06-9a75-919dd3bfc9d6 None admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:47.516750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7971-4db7-4f8c-a64a-8ab42be0b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:47.518069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7971-4db7-4f8c-a64a-8ab42be0b401 None admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:47.518598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7971-4db7-4f8c-a64a-8ab42be0b401 None admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:47.519018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7971-4db7-4f8c-a64a-8ab42be0b401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:47.519830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7971-4db7-4f8c-a64a-8ab42be0b401 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:47.521382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7971-4db7-4f8c-a64a-8ab42be0b401 None admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:47.545803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 644/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:37:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:57.344218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=30 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:57.542546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:06.417440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8da9-93b4-4a76-96fc-23fee16fc5ab None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:06.418315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8da9-93b4-4a76-96fc-23fee16fc5ab None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:06.418315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8da9-93b4-4a76-96fc-23fee16fc5ab None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:06.419691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 663/1307] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:39:06.426406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1d46-d8f5-453c-9894-2681f1b3372d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:06.427224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1d46-d8f5-453c-9894-2681f1b3372d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:06.427224 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1d46-d8f5-453c-9894-2681f1b3372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:06.547647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-dd2b1d46-d8f5-453c-9894-2681f1b3372d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:06.548954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-dd2b1d46-d8f5-453c-9894-2681f1b3372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:06.684303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 645/1308] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:07.229335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc0ac-6062-4f10-9817-27c73dcce6a8 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:07.230780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc0ac-6062-4f10-9817-27c73dcce6a8 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:07.231568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc0ac-6062-4f10-9817-27c73dcce6a8 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:07.236368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 664/1309] 10.222.0.44 () {54 vars in 964 bytes} [Fri Oct 28 09:39:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:07.249642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357d8f5-a802-4921-9f71-d526853a314f None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:07.250175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357d8f5-a802-4921-9f71-d526853a314f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:07.250535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357d8f5-a802-4921-9f71-d526853a314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:07.438842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-9357d8f5-a802-4921-9f71-d526853a314f None None] MFA Rules not processed for user `828e306d81f64846b2b8f07b3dd1e5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:07.440950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9357d8f5-a802-4921-9f71-d526853a314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:07.483457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:07.614424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 646/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Fri Oct 28 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:07.630498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bc0ac-6062-4f10-9817-27c73dcce6a8 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:07.635156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-1d0bc0ac-6062-4f10-9817-27c73dcce6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:07.928372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bc0ac-6062-4f10-9817-27c73dcce6a8 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:08.122061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:08.124544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:08.124985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:08.125461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:08.135485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:08.297108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:08.443418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:08.447479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25adc4-6a2b-4b5e-919b-ef605917eaac service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:08.508618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 665/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:11.358341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646643c-f1cf-48bf-9c0b-7012faf65ee6 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:11.359210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646643c-f1cf-48bf-9c0b-7012faf65ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:11.359210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646643c-f1cf-48bf-9c0b-7012faf65ee6 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:11.360963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 647/1312] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:11.368642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4b49-675a-4435-8dad-ad3fe7b832d0 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:11.369133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4b49-675a-4435-8dad-ad3fe7b832d0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:11.369258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4b49-675a-4435-8dad-ad3fe7b832d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:11.466938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-2bab4b49-675a-4435-8dad-ad3fe7b832d0 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:11.468173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-2bab4b49-675a-4435-8dad-ad3fe7b832d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:11.578376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 666/1313] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:11.889875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80065-bcc2-4040-b2f8-08ef473ecf83 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:11.890209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80065-bcc2-4040-b2f8-08ef473ecf83 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:11.890486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80065-bcc2-4040-b2f8-08ef473ecf83 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:11.891948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 648/1314] 10.222.0.44 () {54 vars in 964 bytes} [Fri Oct 28 09:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:11.898882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8237f60-4e92-4e7b-adff-42fba41e8d8c None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:11.899169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8237f60-4e92-4e7b-adff-42fba41e8d8c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:11.899448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8237f60-4e92-4e7b-adff-42fba41e8d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:11.913786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:11.992144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c8237f60-4e92-4e7b-adff-42fba41e8d8c None None] MFA Rules not processed for user `828e306d81f64846b2b8f07b3dd1e5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:11.993428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c8237f60-4e92-4e7b-adff-42fba41e8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:12.080412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 667/1315] 10.222.0.44 () {58 vars in 1061 bytes} [Fri Oct 28 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:12.090131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80065-bcc2-4040-b2f8-08ef473ecf83 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:12.091881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-91f80065-bcc2-4040-b2f8-08ef473ecf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:12.211292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80065-bcc2-4040-b2f8-08ef473ecf83 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:12.297179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:12.299933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:12.300647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:12.301215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:12.301744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:12.304007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:12.444183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:12.445775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038ef8-62d6-444f-b861-1bee8d7be735 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:12.467556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 649/1316] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:15.433333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007710ed-0475-4e98-8f8d-6ca3b5ae28ff None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:15.434143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007710ed-0475-4e98-8f8d-6ca3b5ae28ff None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:15.434143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007710ed-0475-4e98-8f8d-6ca3b5ae28ff None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:15.435478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 668/1317] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:15.442595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb399-5fd0-4984-99a7-78d5ccff65c8 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:15.443417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb399-5fd0-4984-99a7-78d5ccff65c8 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:15.443577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bb399-5fd0-4984-99a7-78d5ccff65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:15.530241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-a74bb399-5fd0-4984-99a7-78d5ccff65c8 None None] MFA Rules not processed for user `36a7fb13d1554e398c0fa58a63147893`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:15.532099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a74bb399-5fd0-4984-99a7-78d5ccff65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:15.603624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:15.671306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 650/1318] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:39:15.999366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007710ed-0475-4e98-8f8d-6ca3b5ae28ff None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:16.001137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-007710ed-0475-4e98-8f8d-6ca3b5ae28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:16.158419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007710ed-0475-4e98-8f8d-6ca3b5ae28ff None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:16.162081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:16.271868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:16.272460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:16.272813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:16.274658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:16.277282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:16.490280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:16.491930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a8db5-6520-4d77-af52-f0c17ce7fd96 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:16.517738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 669/1319] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:19.576731 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae166ae-6223-4c5a-bd6a-f124f8e670b4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:19.577402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae166ae-6223-4c5a-bd6a-f124f8e670b4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:19.577402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae166ae-6223-4c5a-bd6a-f124f8e670b4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:19.578963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 651/1320] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:39:19.585641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984e296-49b2-4f81-8978-df2d033f6560 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:19.586261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984e296-49b2-4f81-8978-df2d033f6560 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:19.586261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984e296-49b2-4f81-8978-df2d033f6560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:19.637868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:19.673106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-0984e296-49b2-4f81-8978-df2d033f6560 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:19.674448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0984e296-49b2-4f81-8978-df2d033f6560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:19.793172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 670/1321] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:39:20.125086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae166ae-6223-4c5a-bd6a-f124f8e670b4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.127904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-bae166ae-6223-4c5a-bd6a-f124f8e670b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:20.298496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae166ae-6223-4c5a-bd6a-f124f8e670b4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.391510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.392122 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.392478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.392797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.394566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:20.403517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:20.551794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:20.553561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f61bc-2403-4e21-951b-134d2ff9ea05 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:20.574286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 652/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:24.193658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7486-6735-4b6f-8675-1637cd6edcc9 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.194512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7486-6735-4b6f-8675-1637cd6edcc9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.194512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7486-6735-4b6f-8675-1637cd6edcc9 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.196087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 671/1323] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:24.205773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0275a-7e59-4651-b8f8-8981eb1df1f8 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.206424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0275a-7e59-4651-b8f8-8981eb1df1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.206714 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0275a-7e59-4651-b8f8-8981eb1df1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.327339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-42a0275a-7e59-4651-b8f8-8981eb1df1f8 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:24.329456 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-42a0275a-7e59-4651-b8f8-8981eb1df1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:24.412482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:24.460751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 653/1324] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:24.762558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7486-6735-4b6f-8675-1637cd6edcc9 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:24.764864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-21db7486-6735-4b6f-8675-1637cd6edcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:24.895247 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7486-6735-4b6f-8675-1637cd6edcc9 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:24.910509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:25.019915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.020657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.021036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.021401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.023469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:25.218085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.219596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586bdc-57ac-4a43-88b1-a1b3a7196880 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.243781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 672/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:28.493124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc79fe-9da9-434d-9c83-38c91ce0d455 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:28.493730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc79fe-9da9-434d-9c83-38c91ce0d455 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:28.494178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc79fe-9da9-434d-9c83-38c91ce0d455 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:28.496888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 654/1326] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:28.505843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218fe6-9775-4b4a-923a-2bcb69d3219b None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:28.506693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218fe6-9775-4b4a-923a-2bcb69d3219b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:28.506693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218fe6-9775-4b4a-923a-2bcb69d3219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:28.576729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:28.610986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-7b218fe6-9775-4b4a-923a-2bcb69d3219b None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:28.613014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7b218fe6-9775-4b4a-923a-2bcb69d3219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:28.803615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 673/1327] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:29.101983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc79fe-9da9-434d-9c83-38c91ce0d455 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.103814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-cbcc79fe-9da9-434d-9c83-38c91ce0d455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:29.314881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc79fe-9da9-434d-9c83-38c91ce0d455 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:29.473518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:29.474626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:29.475135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:29.475633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:29.479078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:29.516443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:29.646715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:29.648119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c5afc-1777-46b7-a1cb-e039d750b091 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:29.669737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 655/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:32.221116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292cb24-0ac2-46e6-a533-580ece1e0946 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:32.221956 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292cb24-0ac2-46e6-a533-580ece1e0946 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:32.222132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292cb24-0ac2-46e6-a533-580ece1e0946 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:32.224508 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 674/1329] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:32.233199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f37899-a016-4fb8-b41a-1553025cfb27 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:32.234064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f37899-a016-4fb8-b41a-1553025cfb27 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:32.234377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f37899-a016-4fb8-b41a-1553025cfb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:32.319728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-51f37899-a016-4fb8-b41a-1553025cfb27 None None] MFA Rules not processed for user `36a7fb13d1554e398c0fa58a63147893`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:32.321110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-51f37899-a016-4fb8-b41a-1553025cfb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:32.411365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:32.456843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 656/1330] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:32.763246 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292cb24-0ac2-46e6-a533-580ece1e0946 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:32.765007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-6292cb24-0ac2-46e6-a533-580ece1e0946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:32.960807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292cb24-0ac2-46e6-a533-580ece1e0946 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:33.008914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:33.093838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:33.094509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:33.094787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:33.095252 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:33.097185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:33.319509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:33.322473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7169bc-2912-479c-86c3-8141393bd071 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:33.352967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 675/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:36.182034 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f154-ab1a-4331-8f8a-61a202ce14c6 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:36.182853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f154-ab1a-4331-8f8a-61a202ce14c6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:36.182853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f154-ab1a-4331-8f8a-61a202ce14c6 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:36.183973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 657/1332] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:36.190679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c4968-609b-4af9-b22c-229fb0668cad None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:36.191301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c4968-609b-4af9-b22c-229fb0668cad None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:36.191435 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c4968-609b-4af9-b22c-229fb0668cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:36.302853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:36.308902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-021c4968-609b-4af9-b22c-229fb0668cad None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:36.311059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-021c4968-609b-4af9-b22c-229fb0668cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:36.429268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 676/1333] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:36.726121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f154-ab1a-4331-8f8a-61a202ce14c6 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:36.727677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a383f154-ab1a-4331-8f8a-61a202ce14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:36.858639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f154-ab1a-4331-8f8a-61a202ce14c6 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:36.951330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:36.952060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:36.952377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:36.952649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:36.954656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:36.986860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:37.109329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:37.110806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782cba9-9df6-463b-a9e0-d65c97d7b334 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:37.132557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 658/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:39.542017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508556-1378-4f33-b7fa-098b69aef852 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:39.542941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508556-1378-4f33-b7fa-098b69aef852 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:39.542941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b508556-1378-4f33-b7fa-098b69aef852 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:39.544969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 677/1335] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:39.551480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425be1-e2f0-460c-9489-5da6f15abfe2 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:39.552209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425be1-e2f0-460c-9489-5da6f15abfe2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:39.552209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425be1-e2f0-460c-9489-5da6f15abfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:39.634272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-14425be1-e2f0-460c-9489-5da6f15abfe2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:39.635765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-14425be1-e2f0-460c-9489-5da6f15abfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:39.729233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:39.757458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 659/1336] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:40.063360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508556-1378-4f33-b7fa-098b69aef852 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:40.064936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0b508556-1378-4f33-b7fa-098b69aef852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:40.193104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b508556-1378-4f33-b7fa-098b69aef852 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:40.229404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:40.287010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:40.287722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:40.288047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:40.288418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:40.290241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:40.425415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:40.426889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f4e2-e8c8-463b-a2b0-d9191edf1be3 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:40.450033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 678/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:43.580345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8047e7-9244-4ec4-85ab-d0b0f322b851 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.580947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8047e7-9244-4ec4-85ab-d0b0f322b851 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.580947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8047e7-9244-4ec4-85ab-d0b0f322b851 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.582259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 660/1338] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:39:43.588191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82705469-afb1-4bbe-9e8f-6648c1418568 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.588800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82705469-afb1-4bbe-9e8f-6648c1418568 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.588800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82705469-afb1-4bbe-9e8f-6648c1418568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.675377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-82705469-afb1-4bbe-9e8f-6648c1418568 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:43.676656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-82705469-afb1-4bbe-9e8f-6648c1418568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:43.688030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:43.818157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 679/1339] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:44.111894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8047e7-9244-4ec4-85ab-d0b0f322b851 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:44.113687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ab8047e7-9244-4ec4-85ab-d0b0f322b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:44.252051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8047e7-9244-4ec4-85ab-d0b0f322b851 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:44.345385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:44.346089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:44.346412 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:44.346727 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:44.348574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:44.396447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:44.488936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:44.490415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea5288-cc7f-44c4-a058-ac4175d59008 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:44.513886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 661/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:49.793498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2dce5-5da7-4453-9a46-a07a3f783976 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:49.794166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2dce5-5da7-4453-9a46-a07a3f783976 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:49.794482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2dce5-5da7-4453-9a46-a07a3f783976 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:49.796091 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 680/1341] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:49.802143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8993c1-da43-4c9f-b118-701b521d64cb None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:49.803134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8993c1-da43-4c9f-b118-701b521d64cb None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:49.803134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8993c1-da43-4c9f-b118-701b521d64cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:49.879990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-8a8993c1-da43-4c9f-b118-701b521d64cb None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:49.881293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8a8993c1-da43-4c9f-b118-701b521d64cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:50.015353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:50.031779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 662/1342] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:50.331144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2dce5-5da7-4453-9a46-a07a3f783976 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:50.332719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-f5d2dce5-5da7-4453-9a46-a07a3f783976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:50.507437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2dce5-5da7-4453-9a46-a07a3f783976 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:50.586125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:50.660604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:50.661611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:50.662070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:50.662529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:50.665677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:50.854290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:50.856390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025994f-a568-427d-9c34-58c789be0dd9 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:50.880057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 681/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:54.180547 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7ca7-808f-4b22-a8d3-22e472369fe7 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:54.181325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7ca7-808f-4b22-a8d3-22e472369fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:54.181325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af7ca7-808f-4b22-a8d3-22e472369fe7 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:54.182707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 663/1344] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:54.190518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71066824-cb11-4055-a5f7-95f30821131e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:54.191374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71066824-cb11-4055-a5f7-95f30821131e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:54.191518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71066824-cb11-4055-a5f7-95f30821131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:54.295600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-71066824-cb11-4055-a5f7-95f30821131e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:54.297042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-71066824-cb11-4055-a5f7-95f30821131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:54.319845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:54.434517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 682/1345] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:39:54.884723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af7ca7-808f-4b22-a8d3-22e472369fe7 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:54.886345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f3af7ca7-808f-4b22-a8d3-22e472369fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:55.093094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af7ca7-808f-4b22-a8d3-22e472369fe7 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:55.242185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:55.243183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:55.243484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:55.243874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:55.245744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:55.305544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:55.415847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:55.420538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458afbe-19e5-4dcc-8657-43c62a945e98 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:55.454953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 664/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:39:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:40:00.531358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fb5f-7d85-465d-8718-bd6a75b09e2e None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:00.532358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fb5f-7d85-465d-8718-bd6a75b09e2e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:00.532358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fb5f-7d85-465d-8718-bd6a75b09e2e None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:00.533804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 683/1347] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:00.539761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474cb0-334a-4e9d-b755-4ee36ae1c9b7 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:00.540652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474cb0-334a-4e9d-b755-4ee36ae1c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:00.540652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474cb0-334a-4e9d-b755-4ee36ae1c9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:00.633916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-53474cb0-334a-4e9d-b755-4ee36ae1c9b7 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:00.635190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-53474cb0-334a-4e9d-b755-4ee36ae1c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:00.811187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:00.815281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 665/1348] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:01.123927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fb5f-7d85-465d-8718-bd6a75b09e2e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:01.125551 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0595fb5f-7d85-465d-8718-bd6a75b09e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:01.322593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fb5f-7d85-465d-8718-bd6a75b09e2e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:01.408520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:01.474053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:01.475304 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:01.475575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:01.476099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:01.478979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:01.635004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:01.639203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a41684-9e1a-4081-93c7-4c9cdd52501d service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:01.673868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 684/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:07.607291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3d570-322f-49a4-a566-5de836a4497c None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:07.607763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3d570-322f-49a4-a566-5de836a4497c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:07.607858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3d570-322f-49a4-a566-5de836a4497c None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:07.610882 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 666/1350] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:07.619419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff603-3ec3-4891-b083-21c0911dc297 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:07.619883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff603-3ec3-4891-b083-21c0911dc297 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:07.621781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff603-3ec3-4891-b083-21c0911dc297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:07.801146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-915ff603-3ec3-4891-b083-21c0911dc297 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:07.803150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-915ff603-3ec3-4891-b083-21c0911dc297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:07.834740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:08.030665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 685/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:40:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:13.894165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2671f16-8e32-4f36-bbd2-77425d173399 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:13.894742 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2671f16-8e32-4f36-bbd2-77425d173399 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:13.895119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2671f16-8e32-4f36-bbd2-77425d173399 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:13.897921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 667/1352] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:40:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:13.905498 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713891-33ea-4cc8-b414-d65fd1526b93 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:13.906932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713891-33ea-4cc8-b414-d65fd1526b93 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:13.907544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713891-33ea-4cc8-b414-d65fd1526b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:14.061649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-83713891-33ea-4cc8-b414-d65fd1526b93 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:14.063597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-83713891-33ea-4cc8-b414-d65fd1526b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:14.216352 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:14.303871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 686/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:16.007967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f96564-1d2a-4343-b12b-b16efa92b7cd None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:16.008793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f96564-1d2a-4343-b12b-b16efa92b7cd None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:16.008793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f96564-1d2a-4343-b12b-b16efa92b7cd None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:16.010601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 668/1354] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:40:16.017970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf588-e521-4779-a5ad-7c6ba08a32ce None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:16.018758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf588-e521-4779-a5ad-7c6ba08a32ce None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:16.018758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf588-e521-4779-a5ad-7c6ba08a32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:16.122601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-239cf588-e521-4779-a5ad-7c6ba08a32ce None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:16.124027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-239cf588-e521-4779-a5ad-7c6ba08a32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:16.287071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 687/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:40:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:20.689164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663128-ed03-4bcf-8e18-d18103f0d65b None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:20.690229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663128-ed03-4bcf-8e18-d18103f0d65b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:20.690229 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663128-ed03-4bcf-8e18-d18103f0d65b None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:20.691647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 669/1356] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:20.698334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b8d4b-71fc-46f3-808b-07153834575a None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:20.699425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b8d4b-71fc-46f3-808b-07153834575a None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:20.699795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b8d4b-71fc-46f3-808b-07153834575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:20.742479 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:20.818847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-253b8d4b-71fc-46f3-808b-07153834575a None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:20.821726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-253b8d4b-71fc-46f3-808b-07153834575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:21.000301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 688/1357] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:21.335283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f304b-2f34-4dca-a829-997cdc919c31 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:21.336080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f304b-2f34-4dca-a829-997cdc919c31 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:21.337020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f304b-2f34-4dca-a829-997cdc919c31 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:21.339119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 670/1358] 10.222.0.44 () {54 vars in 960 bytes} [Fri Oct 28 09:40:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:40:21.349471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7374-46d7-42b0-9fa1-5a3cf6d88040 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:21.350173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7374-46d7-42b0-9fa1-5a3cf6d88040 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:21.351007 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7374-46d7-42b0-9fa1-5a3cf6d88040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:21.461214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-19cc7374-46d7-42b0-9fa1-5a3cf6d88040 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:21.462675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-19cc7374-46d7-42b0-9fa1-5a3cf6d88040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:21.526825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:21.614990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 689/1359] 10.222.0.44 () {58 vars in 1057 bytes} [Fri Oct 28 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:21.624181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f304b-2f34-4dca-a829-997cdc919c31 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:21.626001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-194f304b-2f34-4dca-a829-997cdc919c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:21.813729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f304b-2f34-4dca-a829-997cdc919c31 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:21.901310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:21.952802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:21.953552 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:21.953832 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:21.954110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:21.955784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:22.075241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:22.076973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e39009-80ad-4455-835c-a5181e98f311 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:22.101584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 671/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:25.324020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8d06-af2c-4a13-ae43-31437d465163 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:25.324020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8d06-af2c-4a13-ae43-31437d465163 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:25.324020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8d06-af2c-4a13-ae43-31437d465163 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:25.339134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e5c0-1467-4262-a97c-5f9a780531ba None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:25.339134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e5c0-1467-4262-a97c-5f9a780531ba None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:25.339134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e5c0-1467-4262-a97c-5f9a780531ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:25.345266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 690/1361] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:25 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:25.488883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-fc23e5c0-1467-4262-a97c-5f9a780531ba None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:25.490357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-fc23e5c0-1467-4262-a97c-5f9a780531ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:25.579639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:25.724768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 672/1362] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:26.335057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8d06-af2c-4a13-ae43-31437d465163 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:26.339641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-580d8d06-af2c-4a13-ae43-31437d465163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:26.677058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8d06-af2c-4a13-ae43-31437d465163 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:26.692863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:26.850474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:26.851120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:26.851421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:26.851692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:26.853948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:26.989430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:26.991669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e50da-1184-49ca-9431-2bd79536158c service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:27.017909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 691/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:29.936810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90c06-74d1-4769-a323-c1520354eca3 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:29.937738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90c06-74d1-4769-a323-c1520354eca3 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:29.937738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90c06-74d1-4769-a323-c1520354eca3 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:29.939273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 673/1364] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:40:29.946294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394864-700d-436d-9547-4f536d232095 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:29.948221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394864-700d-436d-9547-4f536d232095 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:29.950945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394864-700d-436d-9547-4f536d232095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:30.004275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:30.134982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-dc394864-700d-436d-9547-4f536d232095 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:30.137356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-dc394864-700d-436d-9547-4f536d232095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:30.271170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 692/1365] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:30.597570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ebeeb-eaa5-48fb-aca1-33ce2d273ebd None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:30.600722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ebeeb-eaa5-48fb-aca1-33ce2d273ebd None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:30.601470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ebeeb-eaa5-48fb-aca1-33ce2d273ebd None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:30.603287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 674/1366] 10.222.0.44 () {54 vars in 960 bytes} [Fri Oct 28 09:40:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:30.611383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd4b01-ba7c-41ff-9190-626834ade049 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:30.612103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd4b01-ba7c-41ff-9190-626834ade049 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:30.612636 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd4b01-ba7c-41ff-9190-626834ade049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:30.731752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5bfd4b01-ba7c-41ff-9190-626834ade049 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:30.733268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5bfd4b01-ba7c-41ff-9190-626834ade049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:30.783916 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:30.908155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 693/1367] 10.222.0.44 () {58 vars in 1057 bytes} [Fri Oct 28 09:40:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:30.920300 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ebeeb-eaa5-48fb-aca1-33ce2d273ebd None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:30.920527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7a6ebeeb-eaa5-48fb-aca1-33ce2d273ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:31.252037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ebeeb-eaa5-48fb-aca1-33ce2d273ebd None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:31.288119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:31.474061 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:31.474932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:31.475413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:31.475902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:31.478158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:31.619148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79759e5f-d0eb-4140-84b5-d221cbf7e0d2 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:31.619815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79759e5f-d0eb-4140-84b5-d221cbf7e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:31.619815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79759e5f-d0eb-4140-84b5-d221cbf7e0d2 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:31.621777 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 694/1368] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:40:31.627553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcb3e-cf9e-473b-a6e3-d1251c6a7b15 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:31.627860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcb3e-cf9e-473b-a6e3-d1251c6a7b15 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:31.628200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddcb3e-cf9e-473b-a6e3-d1251c6a7b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:31.640583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:31.642924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fdb34-b486-402f-9fd8-ed9404af1755 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:31.671097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 675/1369] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:31.733696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-21ddcb3e-cf9e-473b-a6e3-d1251c6a7b15 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:31.735760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-21ddcb3e-cf9e-473b-a6e3-d1251c6a7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:31.929433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:31.943233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 695/1370] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:32.309222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8127c6-63ab-43c2-8f23-f0c4cff5b669 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:32.309845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8127c6-63ab-43c2-8f23-f0c4cff5b669 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:32.310706 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8127c6-63ab-43c2-8f23-f0c4cff5b669 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:32.314364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 676/1371] 10.222.0.44 () {54 vars in 957 bytes} [Fri Oct 28 09:40:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:32.320200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b7ba-cc7c-4f09-9f08-4b5362b473fa None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:32.320523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b7ba-cc7c-4f09-9f08-4b5362b473fa None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:32.320833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b7ba-cc7c-4f09-9f08-4b5362b473fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:32.443101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-a6d1b7ba-cc7c-4f09-9f08-4b5362b473fa None None] MFA Rules not processed for user `a6b9ce9facf54e809bd8e569b27a6791`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:32.444401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-a6d1b7ba-cc7c-4f09-9f08-4b5362b473fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:32.552169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 696/1372] 10.222.0.44 () {58 vars in 1054 bytes} [Fri Oct 28 09:40:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:32.564189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8127c6-63ab-43c2-8f23-f0c4cff5b669 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:32.567117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8e8127c6-63ab-43c2-8f23-f0c4cff5b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:32.632885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:32.817370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8127c6-63ab-43c2-8f23-f0c4cff5b669 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:32.974011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b9ce9facf54e809bd8e569b27a6791', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:32.974651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:32.975095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:32.975376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:32.977129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:33.082151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:33.133415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:33.135291 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c76c2-f1b2-45fe-bc24-534e5f6a1b4c service cinder] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:33.164371 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 677/1373] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:34.290313 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67682e4-516d-47de-a4dc-0dd981a80f8f None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:34.290896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67682e4-516d-47de-a4dc-0dd981a80f8f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:34.291198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67682e4-516d-47de-a4dc-0dd981a80f8f None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:34.294902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 697/1374] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:34.303991 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241846b2-2b4e-4d75-89a8-7b144bc9f0ee None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:34.304864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241846b2-2b4e-4d75-89a8-7b144bc9f0ee None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:34.304864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241846b2-2b4e-4d75-89a8-7b144bc9f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:34.408087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-241846b2-2b4e-4d75-89a8-7b144bc9f0ee None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:34.409439 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-241846b2-2b4e-4d75-89a8-7b144bc9f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:34.546952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 678/1375] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:34.885055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67682e4-516d-47de-a4dc-0dd981a80f8f None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:34.887410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c67682e4-516d-47de-a4dc-0dd981a80f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:35.007705 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:35.126717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67682e4-516d-47de-a4dc-0dd981a80f8f None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:35.313464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:35.314386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:35.314386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:35.314684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:35.316388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:35.396734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:35.479130 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:35.483069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ad463-acb6-413e-b349-5ab401c6ecf4 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:35.509771 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 698/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:38.366693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686268-97e8-4713-802b-c06b2b00386e None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:38.367222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686268-97e8-4713-802b-c06b2b00386e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:38.367222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686268-97e8-4713-802b-c06b2b00386e None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:38.369009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 679/1377] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:38.377393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136869-eed4-494c-af89-fe554ba2fddd None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:38.377966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136869-eed4-494c-af89-fe554ba2fddd None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:38.377966 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136869-eed4-494c-af89-fe554ba2fddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:38.472951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c1136869-eed4-494c-af89-fe554ba2fddd None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:38.474111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c1136869-eed4-494c-af89-fe554ba2fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:38.650664 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 699/1378] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:38.967202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e686268-97e8-4713-802b-c06b2b00386e None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:38.970512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8e686268-97e8-4713-802b-c06b2b00386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:39.048119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:39.205601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e686268-97e8-4713-802b-c06b2b00386e None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:39.438505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:39.450943 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:39.452002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:39.452527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:39.453030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:39.456299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:39.648682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:39.651970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb845522-86e3-4ce1-8e16-e3027391edca service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:39.691330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 680/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:42.118693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c18-d23f-455f-a153-78c346894646 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:42.120424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c18-d23f-455f-a153-78c346894646 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:42.121238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c18-d23f-455f-a153-78c346894646 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:42.126848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 700/1380] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:42.132214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99611e44-52b5-4354-9a6d-21b28274e409 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:42.133155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99611e44-52b5-4354-9a6d-21b28274e409 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:42.133155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99611e44-52b5-4354-9a6d-21b28274e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:42.222273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-99611e44-52b5-4354-9a6d-21b28274e409 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:42.223556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-99611e44-52b5-4354-9a6d-21b28274e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:42.333545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:42.378983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 681/1381] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:42.967402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58c18-d23f-455f-a153-78c346894646 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:42.970055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-cec58c18-d23f-455f-a153-78c346894646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:43.025476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:43.227171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58c18-d23f-455f-a153-78c346894646 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:43.379093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:43.399844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:43.400569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:43.400896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:43.401198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:43.403678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:43.689748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:43.691725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a584c7d-24f1-45cf-88b1-521e12559393 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:43.717789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 701/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:47.143443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b7454-5029-4c55-9bad-a0fddfad280a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:47.144337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b7454-5029-4c55-9bad-a0fddfad280a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:47.144337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b7454-5029-4c55-9bad-a0fddfad280a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:47.146093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 682/1383] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:47.156217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ae62-d38a-47ce-9ea4-d4ebc3da7628 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:47.156988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ae62-d38a-47ce-9ea4-d4ebc3da7628 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:47.157366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ae62-d38a-47ce-9ea4-d4ebc3da7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:47.287409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-0a68ae62-d38a-47ce-9ea4-d4ebc3da7628 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:47.288923 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0a68ae62-d38a-47ce-9ea4-d4ebc3da7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:47.383270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:47.436767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 702/1384] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:47.829026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b7454-5029-4c55-9bad-a0fddfad280a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:47.830950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e01b7454-5029-4c55-9bad-a0fddfad280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:48.068290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b7454-5029-4c55-9bad-a0fddfad280a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:48.169070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:48.267904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:48.268694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:48.269059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:48.269335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:48.271197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:48.415062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:48.418128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8c510-243b-4792-9ed1-769ed8947325 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:48.457665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 683/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:50.865556 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9a12-b87b-494a-9133-3b501909c0ef None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:50.866349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9a12-b87b-494a-9133-3b501909c0ef None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:50.866349 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d9a12-b87b-494a-9133-3b501909c0ef None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:50.867511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 703/1386] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:40:50.875813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e110bb-e8d5-484e-b04b-7cf8cba43334 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:50.876437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e110bb-e8d5-484e-b04b-7cf8cba43334 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:50.876804 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e110bb-e8d5-484e-b04b-7cf8cba43334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:50.971157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-b7e110bb-e8d5-484e-b04b-7cf8cba43334 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:50.972472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-b7e110bb-e8d5-484e-b04b-7cf8cba43334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:50.983625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:51.102809 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 684/1387] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:51.409285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9a12-b87b-494a-9133-3b501909c0ef None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:51.411086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-927d9a12-b87b-494a-9133-3b501909c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:51.596068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d9a12-b87b-494a-9133-3b501909c0ef None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:51.658861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:51.744135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813035-f24e-44de-8fff-79ef96553206 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:51.744616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813035-f24e-44de-8fff-79ef96553206 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:51.745125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813035-f24e-44de-8fff-79ef96553206 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:51.755197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 685/1388] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:51.762778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b5e72-6d45-4281-b2f9-95b9d27d0a14 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:51.763529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b5e72-6d45-4281-b2f9-95b9d27d0a14 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:51.764874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b5e72-6d45-4281-b2f9-95b9d27d0a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:51.780868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:51.783271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:51.783720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:51.784189 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:51.791165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:51.877933 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-eb4b5e72-6d45-4281-b2f9-95b9d27d0a14 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:51.879192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-eb4b5e72-6d45-4281-b2f9-95b9d27d0a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:51.927141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:51.930606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a150350-37f4-4225-bf6c-655625ab99f5 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:51.964475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 704/1389] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:40:52.042557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:52.066275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 686/1390] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:52.394318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac6843-5a0a-4e5b-bca1-87e91456938b None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:52.394603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac6843-5a0a-4e5b-bca1-87e91456938b None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:52.394867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac6843-5a0a-4e5b-bca1-87e91456938b None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:52.396266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 705/1391] 10.222.0.44 () {54 vars in 962 bytes} [Fri Oct 28 09:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:52.402616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb2f3-c122-4442-8fbd-e620e5926777 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:52.403114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb2f3-c122-4442-8fbd-e620e5926777 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:52.403533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb2f3-c122-4442-8fbd-e620e5926777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:52.504182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-28ceb2f3-c122-4442-8fbd-e620e5926777 None None] MFA Rules not processed for user `3233db58d77647ba9687c8d51a427eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:52.505465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-28ceb2f3-c122-4442-8fbd-e620e5926777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:52.601342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 687/1392] 10.222.0.44 () {58 vars in 1059 bytes} [Fri Oct 28 09:40:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:52.611298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac6843-5a0a-4e5b-bca1-87e91456938b None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:52.613312 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0dac6843-5a0a-4e5b-bca1-87e91456938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:52.678881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:52.745447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac6843-5a0a-4e5b-bca1-87e91456938b None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:52.838691 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3233db58d77647ba9687c8d51a427eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:52.839807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:52.840179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:52.840492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:52.842267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:52.973421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:52.990380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:52.991909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40811cc-7f89-4537-b640-d48fffdd9c7f service glance] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:53.015455 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 706/1393] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:40:53.844965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53e1a-e969-4f8a-b84d-fd38e5804533 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:53.845954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53e1a-e969-4f8a-b84d-fd38e5804533 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:53.846248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53e1a-e969-4f8a-b84d-fd38e5804533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:53.932098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-71f53e1a-e969-4f8a-b84d-fd38e5804533 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:53.934898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-71f53e1a-e969-4f8a-b84d-fd38e5804533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:53.997116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:54.075481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 688/1394] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:40:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:40:54.127364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc385-9f20-4fc6-95a4-517337ddd621 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:54.128039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc385-9f20-4fc6-95a4-517337ddd621 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:54.128510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc385-9f20-4fc6-95a4-517337ddd621 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:54.131108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 707/1395] 10.222.0.44 () {54 vars in 943 bytes} [Fri Oct 28 09:40:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:54.139409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3af9f5-910b-4ef5-985f-00b67b7986b6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:54.139766 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3af9f5-910b-4ef5-985f-00b67b7986b6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:54.140156 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3af9f5-910b-4ef5-985f-00b67b7986b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:54.238670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-5e3af9f5-910b-4ef5-985f-00b67b7986b6 None None] MFA Rules not processed for user `3666250d3b11459e84b2e3b672f9ba3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:54.240222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-5e3af9f5-910b-4ef5-985f-00b67b7986b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:54.412981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 689/1396] 10.222.0.44 () {58 vars in 1040 bytes} [Fri Oct 28 09:40:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:54.425022 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdc385-9f20-4fc6-95a4-517337ddd621 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:54.426675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-93fdc385-9f20-4fc6-95a4-517337ddd621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:54.606387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdc385-9f20-4fc6-95a4-517337ddd621 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:54.709820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:54.791394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:54.792994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:54.793475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:54.793955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:54.797284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:54.943865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:54.945758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa665e9-2371-4a53-8176-7b4c3774fe8c service swift] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:54.957134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 708/1397] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:40:55.215085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847c15-4d72-48d3-a510-3ea1ec579ee6 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:55.215898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847c15-4d72-48d3-a510-3ea1ec579ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:55.216301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847c15-4d72-48d3-a510-3ea1ec579ee6 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:55.218812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 690/1398] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:55.226090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6552d-7bd3-4224-8f4f-b885d1897ade None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:55.226670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6552d-7bd3-4224-8f4f-b885d1897ade None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:55.227059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6552d-7bd3-4224-8f4f-b885d1897ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:55.336027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b8c6552d-7bd3-4224-8f4f-b885d1897ade None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:55.338018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b8c6552d-7bd3-4224-8f4f-b885d1897ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:55.450483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:55.551293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 709/1399] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:40:55.878015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13847c15-4d72-48d3-a510-3ea1ec579ee6 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:40:55.880450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-13847c15-4d72-48d3-a510-3ea1ec579ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:55.892958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:56.159651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13847c15-4d72-48d3-a510-3ea1ec579ee6 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:40:56.293890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:56.345426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:40:56.347188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:56.347468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:56.347750 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:56.349536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:56.535885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:40:56.538607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302cb6-e781-4a57-acc9-64eeadf8b2fa service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:40:56.582575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 691/1400] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:40:59.738978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a3ce1-35dc-43a5-8cbf-676d104f45e1 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:59.740437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a3ce1-35dc-43a5-8cbf-676d104f45e1 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:59.741024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a3ce1-35dc-43a5-8cbf-676d104f45e1 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:59.749853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e2e7-a30f-457c-91f7-45f5564a8ae5 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:40:59.751356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e2e7-a30f-457c-91f7-45f5564a8ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:40:59.752220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e2e7-a30f-457c-91f7-45f5564a8ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:40:59.756357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 710/1401] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:40:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:40:59.863306 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-7483e2e7-a30f-457c-91f7-45f5564a8ae5 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:40:59.864733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7483e2e7-a30f-457c-91f7-45f5564a8ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:40:59.943121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:00.060393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 692/1402] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:00.379925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a3ce1-35dc-43a5-8cbf-676d104f45e1 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:00.382501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-a75a3ce1-35dc-43a5-8cbf-676d104f45e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:00.658112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a3ce1-35dc-43a5-8cbf-676d104f45e1 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:00.717408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:00.869148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:00.870873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:00.871244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:00.871736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:00.875206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:01.060042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:01.061718 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bf3e9-319e-4af1-bad0-b3b7193316b8 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:01.089669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 711/1403] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:03.951476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750ed4f-563e-48b2-a06a-ba24b311cf61 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:03.952176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750ed4f-563e-48b2-a06a-ba24b311cf61 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:03.952176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750ed4f-563e-48b2-a06a-ba24b311cf61 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:03.954760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 693/1404] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:41:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:03.970744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4f70-0f77-4197-8d47-7732c161c891 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:03.971515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4f70-0f77-4197-8d47-7732c161c891 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:03.971653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4f70-0f77-4197-8d47-7732c161c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:04.102000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:04.129908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-ac5a4f70-0f77-4197-8d47-7732c161c891 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:04.132011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-ac5a4f70-0f77-4197-8d47-7732c161c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:04.364595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 712/1405] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:04.699986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750ed4f-563e-48b2-a06a-ba24b311cf61 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:04.701677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-6750ed4f-563e-48b2-a06a-ba24b311cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:04.964450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750ed4f-563e-48b2-a06a-ba24b311cf61 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:05.018611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:05.230185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:05.232029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:05.232610 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:05.233110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:05.235436 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:05.486231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:05.491365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa266084-b847-43ac-83b9-3f2c0da605f3 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:05.547248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 694/1406] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 848 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:08.448446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60710d-e932-4bde-8416-6637b0c69e23 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:08.448446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60710d-e932-4bde-8416-6637b0c69e23 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:08.449504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60710d-e932-4bde-8416-6637b0c69e23 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:08.456310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 713/1407] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:41:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:41:08.461671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00798-eaa4-43cb-b679-c142be9360e6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:08.462518 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00798-eaa4-43cb-b679-c142be9360e6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:08.462694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00798-eaa4-43cb-b679-c142be9360e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:08.532128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:08.576900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-82c00798-eaa4-43cb-b679-c142be9360e6 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:08.578875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-82c00798-eaa4-43cb-b679-c142be9360e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:08.753283 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 695/1408] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:09.074414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60710d-e932-4bde-8416-6637b0c69e23 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:09.076078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5f60710d-e932-4bde-8416-6637b0c69e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:09.264128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:09.309909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60710d-e932-4bde-8416-6637b0c69e23 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:09.577603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:09.578749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:09.579248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:09.579793 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:09.583190 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:09.730295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:09.747900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:09.749925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5d3b5-a3de-4ebe-aa1d-ce7ece59db86 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:09.791284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 714/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:18.751398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=51 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:19.787688 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=8 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:23.598593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cf31-3a08-4640-a5a1-d366da569cc4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:23.599403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cf31-3a08-4640-a5a1-d366da569cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:23.599403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38cf31-3a08-4640-a5a1-d366da569cc4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:23.600813 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 696/1410] 10.222.0.44 () {54 vars in 918 bytes} [Fri Oct 28 09:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:23.606689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4c7a-50cd-43de-8473-7114d362bf82 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:23.607290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4c7a-50cd-43de-8473-7114d362bf82 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:23.607290 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4c7a-50cd-43de-8473-7114d362bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:23.704679 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-9dea4c7a-50cd-43de-8473-7114d362bf82 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:23.705942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-9dea4c7a-50cd-43de-8473-7114d362bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:23.837343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 715/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Oct 28 09:41:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:23.854959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc9395-be84-4778-a602-c4a6853e2c21 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:23.855284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc9395-be84-4778-a602-c4a6853e2c21 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:23.855495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc9395-be84-4778-a602-c4a6853e2c21 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:23.856970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 697/1412] 10.222.0.44 () {54 vars in 918 bytes} [Fri Oct 28 09:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:23.862848 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4dfe6-71bb-4f06-af6b-9d2878e10c49 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:23.863120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4dfe6-71bb-4f06-af6b-9d2878e10c49 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:23.863392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4dfe6-71bb-4f06-af6b-9d2878e10c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:23.968717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:23.972957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-12d4dfe6-71bb-4f06-af6b-9d2878e10c49 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:23.975621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-12d4dfe6-71bb-4f06-af6b-9d2878e10c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:24.136853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 716/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Oct 28 09:41:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:26.974003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a00db-ead0-4bff-a974-a8d5cd56cc92 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:26.974641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a00db-ead0-4bff-a974-a8d5cd56cc92 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:26.974641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a00db-ead0-4bff-a974-a8d5cd56cc92 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:26.976166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:26.983395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b438-53a3-493b-abd0-e436be1f590d None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:26.984076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b438-53a3-493b-abd0-e436be1f590d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:26.984076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b438-53a3-493b-abd0-e436be1f590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:27.095917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d012b438-53a3-493b-abd0-e436be1f590d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:27.097259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d012b438-53a3-493b-abd0-e436be1f590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:27.190271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:27.247770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:27.565830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a00db-ead0-4bff-a974-a8d5cd56cc92 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:27.568515 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-173a00db-ead0-4bff-a974-a8d5cd56cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:27.754769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a00db-ead0-4bff-a974-a8d5cd56cc92 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:27.872752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:27.946599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:27.947226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:27.948217 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:27.948414 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:27.950531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:28.060514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:28.062198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2107996-bba5-422d-9fd4-b7616a9a6661 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:28.084463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 699/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:29.393909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d828-4a1d-4423-a8b0-7b41e1b8bfcb None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:29.394779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d828-4a1d-4423-a8b0-7b41e1b8bfcb None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:29.394779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d828-4a1d-4423-a8b0-7b41e1b8bfcb None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:29.396471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:29.404678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df5f5-eb64-4497-a77a-b1e65e456372 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:29.405570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df5f5-eb64-4497-a77a-b1e65e456372 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:29.405570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135df5f5-eb64-4497-a77a-b1e65e456372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:29.496582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-135df5f5-eb64-4497-a77a-b1e65e456372 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:29.497908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-135df5f5-eb64-4497-a77a-b1e65e456372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:29.530648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:29.626005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:29.788042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d828-4a1d-4423-a8b0-7b41e1b8bfcb None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:29.789663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-8049d828-4a1d-4423-a8b0-7b41e1b8bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:30.010641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d828-4a1d-4423-a8b0-7b41e1b8bfcb None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:30.064893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:30.173338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:30.174025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:30.174350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:30.174666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:30.176657 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:30.290322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:30.292880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1516-5559-4bca-8418-971a585d4a5e service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:30.315305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 719/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:32.015497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ae43d-ade6-4f01-a752-3131361ece41 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:32.016088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ae43d-ade6-4f01-a752-3131361ece41 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:32.016222 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ae43d-ade6-4f01-a752-3131361ece41 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.017580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:32.026396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ae05-77d2-41ce-9b70-e594bd26ec94 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:32.027087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ae05-77d2-41ce-9b70-e594bd26ec94 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:32.027087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ae05-77d2-41ce-9b70-e594bd26ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.091511 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:32.129362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-6756ae05-77d2-41ce-9b70-e594bd26ec94 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:32.130603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-6756ae05-77d2-41ce-9b70-e594bd26ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.243911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:32.410967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ae43d-ade6-4f01-a752-3131361ece41 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:32.413273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-b37ae43d-ade6-4f01-a752-3131361ece41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.599167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ae43d-ade6-4f01-a752-3131361ece41 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:32.614274 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:32.754193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:32.754733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:32.755016 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:32.755293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:32.757071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:32.870167 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:32.871867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b557f4-ab60-4ead-ab3c-be45db92d4d5 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:32.893288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 702/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:34.123149 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a6848-e43a-4e80-b427-3004bfce3c1d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.123847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a6848-e43a-4e80-b427-3004bfce3c1d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.123847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a6848-e43a-4e80-b427-3004bfce3c1d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.125099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:41:34.132901 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7c6e-7a9d-4d83-a0a1-153b7190877c None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.133488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7c6e-7a9d-4d83-a0a1-153b7190877c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.133585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7c6e-7a9d-4d83-a0a1-153b7190877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.156548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.250528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-668b7c6e-7a9d-4d83-a0a1-153b7190877c None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:34.251779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-668b7c6e-7a9d-4d83-a0a1-153b7190877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.367590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:34.525608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a6848-e43a-4e80-b427-3004bfce3c1d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:34.527747 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-fb6a6848-e43a-4e80-b427-3004bfce3c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.667277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.716266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a6848-e43a-4e80-b427-3004bfce3c1d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:34.850715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:34.851393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:34.851674 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:34.851946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:34.853820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:34.943334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.959036 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:34.960806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90c14-49e4-477b-8e8d-251e4f17368b service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:34.980870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 722/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:36.220136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a149e-5f34-4d4c-8e49-fd3abca2a13f None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:36.220769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a149e-5f34-4d4c-8e49-fd3abca2a13f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:36.221178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a149e-5f34-4d4c-8e49-fd3abca2a13f None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:36.223708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:36.231481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2402-ee4c-4afd-bea4-c3541b2d20a7 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:36.232123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2402-ee4c-4afd-bea4-c3541b2d20a7 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:36.232123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2402-ee4c-4afd-bea4-c3541b2d20a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:36.366237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-5d2f2402-ee4c-4afd-bea4-c3541b2d20a7 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:36.368177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-5d2f2402-ee4c-4afd-bea4-c3541b2d20a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:36.527355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:36.690209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a149e-5f34-4d4c-8e49-fd3abca2a13f None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:36.691762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d45a149e-5f34-4d4c-8e49-fd3abca2a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:36.794528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:36.872060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a149e-5f34-4d4c-8e49-fd3abca2a13f None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:37.016265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:37.016935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:37.017212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:37.017609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:37.019334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:37.079534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:37.132589 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:37.134249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d303326-0b7b-47cc-aa6d-03f8208dee0d service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:37.157976 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 705/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:38.334697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23c0f-cf69-4ca1-9f1a-b92f1c1bc886 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:38.335648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23c0f-cf69-4ca1-9f1a-b92f1c1bc886 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:38.335648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23c0f-cf69-4ca1-9f1a-b92f1c1bc886 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:38.337299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:38.345353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c07a6-9da8-4171-943b-e80c9c289386 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:38.346213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c07a6-9da8-4171-943b-e80c9c289386 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:38.346213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c07a6-9da8-4171-943b-e80c9c289386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:38.443763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-764c07a6-9da8-4171-943b-e80c9c289386 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:38.444960 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-764c07a6-9da8-4171-943b-e80c9c289386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:38.565095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:38.719985 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23c0f-cf69-4ca1-9f1a-b92f1c1bc886 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:38.722785 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c1f23c0f-cf69-4ca1-9f1a-b92f1c1bc886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:38.815440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:38.932440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23c0f-cf69-4ca1-9f1a-b92f1c1bc886 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:39.083673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:39.084317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:39.084599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:39.084871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:39.086593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:39.096354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:39.221584 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:39.224755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74055cce-003a-405d-8e0c-60721040b987 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:39.261065 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 725/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:40.444995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1618-00e5-45a6-8f62-a0b2a1ea3858 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:40.445567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1618-00e5-45a6-8f62-a0b2a1ea3858 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:40.445953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1618-00e5-45a6-8f62-a0b2a1ea3858 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:40.449309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:40.456842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878bf0c-37d3-46c4-aa1f-50083b76cab9 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:40.457698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878bf0c-37d3-46c4-aa1f-50083b76cab9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:40.457698 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878bf0c-37d3-46c4-aa1f-50083b76cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:40.548011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-3878bf0c-37d3-46c4-aa1f-50083b76cab9 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:40.549272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3878bf0c-37d3-46c4-aa1f-50083b76cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:40.632271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:40.667531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:40.829647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f1618-00e5-45a6-8f62-a0b2a1ea3858 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:40.831324 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-916f1618-00e5-45a6-8f62-a0b2a1ea3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:40.852559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:41.065954 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f1618-00e5-45a6-8f62-a0b2a1ea3858 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:41.174981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:41.207926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:41.208583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:41.208863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:41.209136 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:41.210839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:41.321791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:41.324269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2134256-813c-48fa-8565-b78718bd4405 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:41.345643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 708/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:42.488094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3926e-7aae-4e59-943e-70b65c05a8cb None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:42.488702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3926e-7aae-4e59-943e-70b65c05a8cb None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:42.488831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3926e-7aae-4e59-943e-70b65c05a8cb None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:42.490360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:42.499040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019a54-d0d1-4cd7-ab5c-7c52b553a336 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:42.499910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019a54-d0d1-4cd7-ab5c-7c52b553a336 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:42.500082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b019a54-d0d1-4cd7-ab5c-7c52b553a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:42.591186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-3b019a54-d0d1-4cd7-ab5c-7c52b553a336 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:42.592454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3b019a54-d0d1-4cd7-ab5c-7c52b553a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:42.643430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:42.714977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:42.870887 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3926e-7aae-4e59-943e-70b65c05a8cb None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:42.872454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-feb3926e-7aae-4e59-943e-70b65c05a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:43.050884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3926e-7aae-4e59-943e-70b65c05a8cb None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:43.119840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:43.199128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:43.199764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:43.200100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:43.200368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:43.202215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:43.318026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:43.319568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47ae2-8796-44aa-9863-b1bb3906b347 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:43.343268 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 728/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:44.519894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fba68-5231-4053-887c-4e4403e079b4 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:44.520609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fba68-5231-4053-887c-4e4403e079b4 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:44.520609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fba68-5231-4053-887c-4e4403e079b4 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:44.522104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:41:44.529939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24fdac-ca50-4cfc-ac90-8f7bc3187caf None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:44.530629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24fdac-ca50-4cfc-ac90-8f7bc3187caf None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:44.530629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24fdac-ca50-4cfc-ac90-8f7bc3187caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:44.622839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-ea24fdac-ca50-4cfc-ac90-8f7bc3187caf None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:44.623983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-ea24fdac-ca50-4cfc-ac90-8f7bc3187caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:44.626494 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:44.763532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:44.917582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fba68-5231-4053-887c-4e4403e079b4 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:44.919019 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-605fba68-5231-4053-887c-4e4403e079b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:45.098454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fba68-5231-4053-887c-4e4403e079b4 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:45.134257 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:45.246141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c11c9-648e-4998-8803-22137157d091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:45.246669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c11c9-648e-4998-8803-22137157d091 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:45.246949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c11c9-648e-4998-8803-22137157d091 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:45.247219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c11c9-648e-4998-8803-22137157d091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:45.248957 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-987c11c9-648e-4998-8803-22137157d091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:45.367580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c11c9-648e-4998-8803-22137157d091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:45.369911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c11c9-648e-4998-8803-22137157d091 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:45.391970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 711/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:47.651486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e61ac-faa6-4a6f-a7a6-ab4a10f07a73 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:47.651486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e61ac-faa6-4a6f-a7a6-ab4a10f07a73 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:47.652559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e61ac-faa6-4a6f-a7a6-ab4a10f07a73 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:47.653168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:41:47.659329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1d10-7865-4069-8db5-b3c2058db53f None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:47.659974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1d10-7865-4069-8db5-b3c2058db53f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:47.659974 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b1d10-7865-4069-8db5-b3c2058db53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:47.714425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:47.746256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-2d8b1d10-7865-4069-8db5-b3c2058db53f None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:47.747571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-2d8b1d10-7865-4069-8db5-b3c2058db53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:47.861177 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:48.172462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e61ac-faa6-4a6f-a7a6-ab4a10f07a73 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:48.174468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-534e61ac-faa6-4a6f-a7a6-ab4a10f07a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:48.333366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e61ac-faa6-4a6f-a7a6-ab4a10f07a73 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:48.379270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:48.432425 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:48.432959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:48.433234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:48.433502 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:48.435159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:48.562739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:48.564184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f615-2517-4a70-ac49-513a7f726fc9 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:48.585495 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 731/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:41:51.138892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de871a25-a571-40e1-8484-886031042bbd None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:51.139501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de871a25-a571-40e1-8484-886031042bbd None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:51.139648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de871a25-a571-40e1-8484-886031042bbd None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:51.141408 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:41:51.147812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363675f5-8f1d-41b9-9879-c371442845db None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:51.148454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363675f5-8f1d-41b9-9879-c371442845db None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:51.148454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363675f5-8f1d-41b9-9879-c371442845db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:51.238074 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-363675f5-8f1d-41b9-9879-c371442845db None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:51.239355 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-363675f5-8f1d-41b9-9879-c371442845db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:51.255841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:51.400263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:51.701873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de871a25-a571-40e1-8484-886031042bbd None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:51.703476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-de871a25-a571-40e1-8484-886031042bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:51.840406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de871a25-a571-40e1-8484-886031042bbd None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:51.855988 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:51.932097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:51.932776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:51.933055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:51.933328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:51.935051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:52.078082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:52.079752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d632b96-c134-4cf3-8f48-8340e5cfac5a service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:52.102411 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 714/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:54.949226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2edbd-848d-4b62-ada7-00d000bfa827 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:54.950100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2edbd-848d-4b62-ada7-00d000bfa827 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:54.950100 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2edbd-848d-4b62-ada7-00d000bfa827 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:54.951669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:54.958054 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1022-f2db-482e-b16d-204150312087 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:54.958592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1022-f2db-482e-b16d-204150312087 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:54.958592 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1022-f2db-482e-b16d-204150312087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:55.015166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:55.038366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-633c1022-f2db-482e-b16d-204150312087 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:55.039611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-633c1022-f2db-482e-b16d-204150312087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:55.154834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:41:55.452617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2edbd-848d-4b62-ada7-00d000bfa827 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:55.454226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3df2edbd-848d-4b62-ada7-00d000bfa827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:55.579605 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2edbd-848d-4b62-ada7-00d000bfa827 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:55.629994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:55.670625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:55.671239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:55.671513 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:55.671784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:55.673483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:55.804884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:55.806356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396861e-9cd0-4fa2-90f8-e7c27080c3c0 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:55.827970 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 734/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:41:58.293055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9617e2-7ca2-4dc1-8966-5c41c4eb0bd5 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:58.293684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9617e2-7ca2-4dc1-8966-5c41c4eb0bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:58.293684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9617e2-7ca2-4dc1-8966-5c41c4eb0bd5 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:58.295015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:41:58.301185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951df3-6783-4f34-a338-9ac02849e294 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:58.301755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951df3-6783-4f34-a338-9ac02849e294 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:58.301755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951df3-6783-4f34-a338-9ac02849e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:58.383893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-3d951df3-6783-4f34-a338-9ac02849e294 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:41:58.386159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3d951df3-6783-4f34-a338-9ac02849e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:58.409982 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:58.503648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:41:58.803059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9617e2-7ca2-4dc1-8966-5c41c4eb0bd5 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:41:58.807323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4f9617e2-7ca2-4dc1-8966-5c41c4eb0bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:58.949903 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9617e2-7ca2-4dc1-8966-5c41c4eb0bd5 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:41:58.976110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:59.065337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:41:59.065977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:41:59.066255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:41:59.066532 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:41:59.068267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:41:59.205331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:41:59.206863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9e1c1-38b4-4465-b9b9-0772ad5255e3 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:41:59.231431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 717/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:01.693740 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b244e3-8a37-4561-984b-80ff738cd9d8 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:01.694347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b244e3-8a37-4561-984b-80ff738cd9d8 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:01.694347 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b244e3-8a37-4561-984b-80ff738cd9d8 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:01.695627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:42:01.704062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb815003-1615-45ff-ad6b-b3b14461aa6a None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:01.704761 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb815003-1615-45ff-ad6b-b3b14461aa6a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:01.704937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb815003-1615-45ff-ad6b-b3b14461aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:01.799828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:01.805211 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-fb815003-1615-45ff-ad6b-b3b14461aa6a None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:01.807478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-fb815003-1615-45ff-ad6b-b3b14461aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:01.930086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:02.482637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b244e3-8a37-4561-984b-80ff738cd9d8 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:02.484216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-78b244e3-8a37-4561-984b-80ff738cd9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:02.616853 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b244e3-8a37-4561-984b-80ff738cd9d8 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:02.676949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:02.711106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:02.711910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:02.712095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:02.712527 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:02.715385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:02.912200 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:02.913624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bf9f8-e995-4a86-89b4-31fe0b783f8b service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:02.937507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 737/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:42:05.543453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535a21d-7037-4359-a0b2-2f7eb2a9a0d0 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:05.544298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535a21d-7037-4359-a0b2-2f7eb2a9a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:05.544298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535a21d-7037-4359-a0b2-2f7eb2a9a0d0 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:05.545418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:05.551543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6c88-fc09-4bcd-aee5-d20445c4823e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:05.552443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6c88-fc09-4bcd-aee5-d20445c4823e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:05.552443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6c88-fc09-4bcd-aee5-d20445c4823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:05.668703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-93ef6c88-fc09-4bcd-aee5-d20445c4823e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:05.671337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-93ef6c88-fc09-4bcd-aee5-d20445c4823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:05.718594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:05.812339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:06.171808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535a21d-7037-4359-a0b2-2f7eb2a9a0d0 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:06.174317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-2535a21d-7037-4359-a0b2-2f7eb2a9a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:06.335184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535a21d-7037-4359-a0b2-2f7eb2a9a0d0 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:06.377359 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:06.459595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:06.460596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:06.461111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:06.461582 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:06.465959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:06.626438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:06.628831 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4f0ac-8605-4277-8a83-f64b1fafdc15 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:06.665601 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 720/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:09.238786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeaf6a-c64e-459a-88bc-2f2b49ff0e83 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:09.239487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeaf6a-c64e-459a-88bc-2f2b49ff0e83 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:09.239487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeaf6a-c64e-459a-88bc-2f2b49ff0e83 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:09.241138 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:09.249166 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c494e-bbd4-4e7f-8ca3-7d3c292b9596 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:09.250088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c494e-bbd4-4e7f-8ca3-7d3c292b9596 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:09.250088 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c494e-bbd4-4e7f-8ca3-7d3c292b9596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:09.347516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-440c494e-bbd4-4e7f-8ca3-7d3c292b9596 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:09.348822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-440c494e-bbd4-4e7f-8ca3-7d3c292b9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:09.361185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:09.492299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:09.797453 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeaf6a-c64e-459a-88bc-2f2b49ff0e83 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:09.799243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-9fdeaf6a-c64e-459a-88bc-2f2b49ff0e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:09.953409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeaf6a-c64e-459a-88bc-2f2b49ff0e83 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:10.023161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:10.048597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:10.049377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:10.049768 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:10.050198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:10.052015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:10.190692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:10.192147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80eecf5-6b34-4784-a9de-d462c7394d42 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:10.214358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 740/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:12.895116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e80ba-98ed-4269-a722-8c230008ba8e None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:12.895713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e80ba-98ed-4269-a722-8c230008ba8e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:12.896112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e80ba-98ed-4269-a722-8c230008ba8e None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:12.898746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:12.906395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62740a62-69c8-40d6-ad8b-fce80a725a05 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:12.907008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62740a62-69c8-40d6-ad8b-fce80a725a05 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:12.907545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62740a62-69c8-40d6-ad8b-fce80a725a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:13.034343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-62740a62-69c8-40d6-ad8b-fce80a725a05 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:13.035595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-62740a62-69c8-40d6-ad8b-fce80a725a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:13.089681 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:13.175883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:13.490514 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e80ba-98ed-4269-a722-8c230008ba8e None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:13.492945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-869e80ba-98ed-4269-a722-8c230008ba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:13.648653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e80ba-98ed-4269-a722-8c230008ba8e None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:13.698689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:13.745942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:13.746758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:13.747147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:13.747606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:13.749767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:13.945799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:13.948762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4f4f5-de15-4bc3-96c3-7d31c6a73c3d service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:13.982938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 723/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:16.433617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10c63-f13f-4c51-8edf-4940539f39ff None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:16.434234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10c63-f13f-4c51-8edf-4940539f39ff None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:16.434234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10c63-f13f-4c51-8edf-4940539f39ff None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:16.435847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:16.442548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e631a7-cd3a-46d6-afd5-cbd1ba951666 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:16.443181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e631a7-cd3a-46d6-afd5-cbd1ba951666 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:16.443181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e631a7-cd3a-46d6-afd5-cbd1ba951666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:16.521310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-f3e631a7-cd3a-46d6-afd5-cbd1ba951666 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:16.522873 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f3e631a7-cd3a-46d6-afd5-cbd1ba951666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:16.545878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:16.645043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:42:16.952073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10c63-f13f-4c51-8edf-4940539f39ff None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:16.953713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-4cb10c63-f13f-4c51-8edf-4940539f39ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:17.093379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10c63-f13f-4c51-8edf-4940539f39ff None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:17.189237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:17.198563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:17.199068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:17.199346 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:17.199621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:17.201365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:17.402154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:17.404802 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1de60d-0eb9-4e52-9f5e-0e610bf4353e service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:17.440604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 743/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:19.966798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba884c3-630d-4a2e-85f2-d66d15b7b630 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:19.967624 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba884c3-630d-4a2e-85f2-d66d15b7b630 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:19.967797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba884c3-630d-4a2e-85f2-d66d15b7b630 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:19.970385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:19.976971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334da47-66da-4d03-a27e-006679005844 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:19.977541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334da47-66da-4d03-a27e-006679005844 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:19.977541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334da47-66da-4d03-a27e-006679005844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:20.061220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-3334da47-66da-4d03-a27e-006679005844 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:20.062463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3334da47-66da-4d03-a27e-006679005844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:20.118798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:20.178006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:42:20.481623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba884c3-630d-4a2e-85f2-d66d15b7b630 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:20.483262 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4ba884c3-630d-4a2e-85f2-d66d15b7b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:20.612343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba884c3-630d-4a2e-85f2-d66d15b7b630 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:20.679213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:20.717132 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:20.717987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:20.718395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:20.718765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:20.720696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:20.858912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:20.860461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826d8c-f505-411c-82a2-136acc48ee8e service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:20.883955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 726/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:42:30.175880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=22 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:30.881250 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=66 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:35.826385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d948b-5824-4b57-a5b5-5af5aab437da None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:35.827258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d948b-5824-4b57-a5b5-5af5aab437da None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:35.827258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d948b-5824-4b57-a5b5-5af5aab437da None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:35.829114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 745/1471] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:35.835255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fab974-697d-4313-b796-21ea2ede9732 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:35.835879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fab974-697d-4313-b796-21ea2ede9732 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:35.835879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fab974-697d-4313-b796-21ea2ede9732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:35.925104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-61fab974-697d-4313-b796-21ea2ede9732 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:35.926364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-61fab974-697d-4313-b796-21ea2ede9732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:36.060461 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 727/1472] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:36.378979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f65ed-45a6-4049-b07e-4f2d93bc65df None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:36.379397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f65ed-45a6-4049-b07e-4f2d93bc65df None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:36.379784 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f65ed-45a6-4049-b07e-4f2d93bc65df None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:36.381372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 746/1473] 10.222.0.44 () {54 vars in 962 bytes} [Fri Oct 28 09:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:36.388092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1521c-5f0f-4f53-ba2b-a0bd4f07e8d8 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:36.388475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1521c-5f0f-4f53-ba2b-a0bd4f07e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:36.388797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1521c-5f0f-4f53-ba2b-a0bd4f07e8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:36.486227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-a1c1521c-5f0f-4f53-ba2b-a0bd4f07e8d8 None None] MFA Rules not processed for user `3233db58d77647ba9687c8d51a427eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:36.487615 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-a1c1521c-5f0f-4f53-ba2b-a0bd4f07e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:36.512953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:36.582075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 728/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Fri Oct 28 09:42:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:36.590437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f65ed-45a6-4049-b07e-4f2d93bc65df None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:36.592135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-308f65ed-45a6-4049-b07e-4f2d93bc65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:36.722924 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f65ed-45a6-4049-b07e-4f2d93bc65df None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:36.816798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3233db58d77647ba9687c8d51a427eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:36.817468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:36.818056 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:36.818423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:36.820383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:36.889236 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:36.979269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:36.981926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc726a1-aeb0-4fcc-af31-ab677ad4bbbc service glance] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:37.020038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 747/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:39.449399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2222e-8cc7-4687-8947-1bda95c22b09 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:39.450089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2222e-8cc7-4687-8947-1bda95c22b09 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:39.450089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2222e-8cc7-4687-8947-1bda95c22b09 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:39.451655 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 729/1476] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:39.458129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c4a18-b0dd-45f4-8c2b-34834a976839 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:39.458971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c4a18-b0dd-45f4-8c2b-34834a976839 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:39.459135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c4a18-b0dd-45f4-8c2b-34834a976839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:39.540846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-e76c4a18-b0dd-45f4-8c2b-34834a976839 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:39.542116 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-e76c4a18-b0dd-45f4-8c2b-34834a976839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:39.660640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 748/1477] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:42:39.940134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2222e-8cc7-4687-8947-1bda95c22b09 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:39.941649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-e5e2222e-8cc7-4687-8947-1bda95c22b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:40.094719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2222e-8cc7-4687-8947-1bda95c22b09 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:40.157591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:40.215904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:40.216641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:40.216955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:40.217241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:40.217941 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:40.219927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:42:40.219927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:42:40.219927 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:42:40.221178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d3d5-e407-413b-b6ae-33ae217233bd admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:40.246068 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 730/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Fri Oct 28 09:42:39 2022] GET /identity/v3/projects => generated 2553 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:42:42.620914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01454c-9861-47e1-baca-521cc45a4540 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:42.621521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01454c-9861-47e1-baca-521cc45a4540 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:42.621521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01454c-9861-47e1-baca-521cc45a4540 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:42.622884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 749/1479] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:42:42.629639 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b89297-835d-4566-ae1d-da906398ad55 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:42.630489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b89297-835d-4566-ae1d-da906398ad55 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:42.630677 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b89297-835d-4566-ae1d-da906398ad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:42.715583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-48b89297-835d-4566-ae1d-da906398ad55 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:42.717682 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-48b89297-835d-4566-ae1d-da906398ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:42.905825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 731/1480] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:42:43.228754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01454c-9861-47e1-baca-521cc45a4540 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:43.232095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-3c01454c-9861-47e1-baca-521cc45a4540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:43.250733 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:43.449426 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01454c-9861-47e1-baca-521cc45a4540 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:43.547013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:43.592198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:43.592844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:43.593120 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:43.593389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:43.595076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:43.717171 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:43.720192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2056-ee72-4dcb-93ab-0c091ddadbd4 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:43.756665 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 750/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:46.277071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f4dc-75fc-4051-9180-05fcefd87a37 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:46.277762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f4dc-75fc-4051-9180-05fcefd87a37 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:46.277762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4f4dc-75fc-4051-9180-05fcefd87a37 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:46.279354 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 732/1482] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:46.286026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd0552-b857-4ddd-acf0-f1c8ddbb08a4 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:46.286866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd0552-b857-4ddd-acf0-f1c8ddbb08a4 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:46.286866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd0552-b857-4ddd-acf0-f1c8ddbb08a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:46.372433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b6dd0552-b857-4ddd-acf0-f1c8ddbb08a4 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:46.374643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b6dd0552-b857-4ddd-acf0-f1c8ddbb08a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:46.466378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:46.543109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 751/1483] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:46.836986 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f4dc-75fc-4051-9180-05fcefd87a37 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:46.838716 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4ab4f4dc-75fc-4051-9180-05fcefd87a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:46.867170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:46.996822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4f4dc-75fc-4051-9180-05fcefd87a37 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:47.146892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:47.147642 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:47.147965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:47.148323 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:47.150828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:47.254626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:47.324025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:47.326786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a08c-299c-4cd7-bc59-b2051895696b service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:47.363790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 733/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:42:49.766618 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d13579-bb78-4dc4-b896-1d0d54da38ba None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:49.767184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d13579-bb78-4dc4-b896-1d0d54da38ba None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:49.767184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d13579-bb78-4dc4-b896-1d0d54da38ba None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:49.768739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 752/1485] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:49.775105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e627-e33c-4a2c-a223-0a15f61ea7d8 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:49.775932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e627-e33c-4a2c-a223-0a15f61ea7d8 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:49.776152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e627-e33c-4a2c-a223-0a15f61ea7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:49.857877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-7431e627-e33c-4a2c-a223-0a15f61ea7d8 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:49.859270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7431e627-e33c-4a2c-a223-0a15f61ea7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:50.002578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 734/1486] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:50.302590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d13579-bb78-4dc4-b896-1d0d54da38ba None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:50.304155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-24d13579-bb78-4dc4-b896-1d0d54da38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:50.435849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d13579-bb78-4dc4-b896-1d0d54da38ba None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:50.546388 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:50.548057 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:50.548798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:50.549329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:50.549663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:50.551932 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:50.691070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:50.692565 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644acfbd-2fad-4af9-8321-a55643a96a3b service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:50.715226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 753/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:42:53.274817 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d029-1811-441e-a2d6-cc9ff0fa9e6a None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:53.276363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d029-1811-441e-a2d6-cc9ff0fa9e6a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:53.276363 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d029-1811-441e-a2d6-cc9ff0fa9e6a None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:53.277186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 735/1488] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:53.283587 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217039e5-5cff-494c-93e9-0de9bd1ede8f None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:53.284182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217039e5-5cff-494c-93e9-0de9bd1ede8f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:53.284182 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217039e5-5cff-494c-93e9-0de9bd1ede8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:53.365331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-217039e5-5cff-494c-93e9-0de9bd1ede8f None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:53.366097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-217039e5-5cff-494c-93e9-0de9bd1ede8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:53.431595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:53.485337 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 754/1489] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:53.790890 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025d029-1811-441e-a2d6-cc9ff0fa9e6a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:53.792846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-7025d029-1811-441e-a2d6-cc9ff0fa9e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:53.835039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:53.916979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025d029-1811-441e-a2d6-cc9ff0fa9e6a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:54.008555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:54.009241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:54.010989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:54.011343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:54.013218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:54.128543 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:54.169819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:54.172728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f1cc3-d90a-426a-a915-2e34a14ec5dd service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:54.344769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 736/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:56.939653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca2b9-466d-4a91-a96d-e1f56e97ba0f None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:56.940367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca2b9-466d-4a91-a96d-e1f56e97ba0f None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:56.940367 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca2b9-466d-4a91-a96d-e1f56e97ba0f None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:56.941715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 755/1491] 10.222.0.44 () {54 vars in 927 bytes} [Fri Oct 28 09:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:42:56.948028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b812f0-d2c2-49f8-bcf0-12bd799a819f None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:56.948696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b812f0-d2c2-49f8-bcf0-12bd799a819f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:56.948696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b812f0-d2c2-49f8-bcf0-12bd799a819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:57.026606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d7b812f0-d2c2-49f8-bcf0-12bd799a819f None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:42:57.028030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d7b812f0-d2c2-49f8-bcf0-12bd799a819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:57.161614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 737/1492] 10.222.0.44 () {58 vars in 1024 bytes} [Fri Oct 28 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:42:57.469271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ca2b9-466d-4a91-a96d-e1f56e97ba0f None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:42:57.471021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-9c7ca2b9-466d-4a91-a96d-e1f56e97ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:57.599281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ca2b9-466d-4a91-a96d-e1f56e97ba0f None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:42:57.690357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:42:57.690871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:42:57.691150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:42:57.691423 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:42:57.693134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:42:57.703792 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:57.833859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:42:57.835546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69972e0f-0eec-48fb-9cef-ee5657a35825 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:42:57.857911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 756/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:43:07.159730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=82 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:07.855109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=50 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:18.759162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:18.760424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:18.760671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:18.866105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:18.868164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:19.018580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 738/1494] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:44:19.027148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.027748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.027748 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.049958 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:19.051239 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:19.061281 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 757/1495] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:44:19.066067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.076303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc23c-b890-4596-97d4-7fc4e2fb01ba None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.081090 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.081721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.082031 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.082310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.082971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:44:19.083278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.084350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:19.084350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:44:19.084350 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:44:19.085258 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.100021 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 739/1496] 10.222.0.44 () {58 vars in 1153 bytes} [Fri Oct 28 09:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:44:19.116259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.133574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f8c62-b396-4eef-8e88-694d07cd1838 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.142075 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.143135 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.143628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.144123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.145329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.151915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:19.151915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:44:19.151915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:44:19.155142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.217906 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 758/1497] 10.222.0.44 () {60 vars in 1153 bytes} [Fri Oct 28 09:44:19 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:44:19.224221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.237276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fbeb-fd8f-4d0b-9e22-93e32f6569ce admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.333128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:19.342018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.342791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.343172 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.343505 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.344210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.345360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:19.345360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:44:19.345360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:44:19.346800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.375402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 740/1498] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:44:19 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:44:19.380234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.393637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a67f3-32f9-4ea6-be4e-73333300a2f8 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.402850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.403501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.403898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.404330 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.405014 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.406058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:19.406058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:44:19.406058 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:44:19.406967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.430081 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 759/1499] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:44:19.435684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.449193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3cf7-267d-4eac-a4d7-7ba7dda01d8d admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.454144 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.454769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.455046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.455318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.455972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.457044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:19.457044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:44:19.457044 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:44:19.457969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558e1fc-9ef4-44ab-955c-cf63deab9b99 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.474881 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 741/1500] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:44:19.479946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.491024 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00fcc-1fbb-4ab6-81a4-c0a031b714ed admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.504378 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.505206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.505571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.505896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] PATH_INFO: `/v3/projects/de6405ebd1344de5a5cd8bafd186ca70/users/4f3f0e8f581440d39baecc99adb0dbcc/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.524827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6405ebd1344de5a5cd8bafd186ca70, user_id=4f3f0e8f581440d39baecc99adb0dbcc, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.526216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:19.526216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:44:19.526216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:44:19.528199 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75838-8a0a-4eef-a34d-a28f2504fd6b admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.544952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 760/1501] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:44:19 2022] PUT /identity/v3/projects/de6405ebd1344de5a5cd8bafd186ca70/users/4f3f0e8f581440d39baecc99adb0dbcc/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:44:19.557981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babc703-9b3f-49b7-9442-455f8f83bc07 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.558578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babc703-9b3f-49b7-9442-455f8f83bc07 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.558781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babc703-9b3f-49b7-9442-455f8f83bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.594035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-5babc703-9b3f-49b7-9442-455f8f83bc07 None None] MFA Rules not processed for user `4f3f0e8f581440d39baecc99adb0dbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:19.595341 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-5babc703-9b3f-49b7-9442-455f8f83bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:19.678255 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 742/1502] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:44:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:19.695390 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70e36-cf25-4483-b09d-49c4d45c3e55 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.695896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70e36-cf25-4483-b09d-49c4d45c3e55 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.696452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70e36-cf25-4483-b09d-49c4d45c3e55 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.699093 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 761/1503] 10.222.0.44 () {54 vars in 957 bytes} [Fri Oct 28 09:44:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:44:19.705110 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8e85-de9f-444f-98f3-1960f657fb0d None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.705471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8e85-de9f-444f-98f3-1960f657fb0d None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.705744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8e85-de9f-444f-98f3-1960f657fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.787863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-852c8e85-de9f-444f-98f3-1960f657fb0d None None] MFA Rules not processed for user `a6b9ce9facf54e809bd8e569b27a6791`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:19.789278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-852c8e85-de9f-444f-98f3-1960f657fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:19.887807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 743/1504] 10.222.0.44 () {58 vars in 1054 bytes} [Fri Oct 28 09:44:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:19.898945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70e36-cf25-4483-b09d-49c4d45c3e55 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:19.921846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70e36-cf25-4483-b09d-49c4d45c3e55 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:19.927238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b9ce9facf54e809bd8e569b27a6791', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:19.928658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:19.929245 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:19.929774 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:19.947865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:19.953713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:19.970898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 762/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:44:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:44:20.060070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2d62-d28e-481e-8b6f-8d30bcaa8d81 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:20.060593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2d62-d28e-481e-8b6f-8d30bcaa8d81 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:20.061089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2d62-d28e-481e-8b6f-8d30bcaa8d81 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:20.063292 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 744/1506] 10.222.0.44 () {52 vars in 830 bytes} [Fri Oct 28 09:44:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:44:20.068913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:20.186263 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f80a1e-8c89-4a49-adfa-ed9607f39d5d service cinder] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:20.191418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:20.192334 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:20.192835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:20.193271 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] PATH_INFO: `/v3/users/4f3f0e8f581440d39baecc99adb0dbcc` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:20.196225 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3f0e8f581440d39baecc99adb0dbcc)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:20.198634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:20.198634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:44:20.198634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:44:20.200037 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:20.302372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3f0e8f581440d39baecc99adb0dbcc'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:20.303235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3f0e8f581440d39baecc99adb0dbcc'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:20.318415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3f0e8f581440d39baecc99adb0dbcc'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:20.319404 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3f0e8f581440d39baecc99adb0dbcc'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:20.341541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3f0e8f581440d39baecc99adb0dbcc'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:20.373573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:20.385812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 763/1507] 10.222.0.44 () {58 vars in 1224 bytes} [Fri Oct 28 09:44:20 2022] DELETE /identity/v3/users/4f3f0e8f581440d39baecc99adb0dbcc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:44:20.392329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:20.392849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:20.393296 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:20.424696 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:44:20.426783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:20.442516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:20.513476 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 745/1508] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:44:20.528198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:20.529693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:20.655827 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119b93-4b1c-4215-a8cb-7ff1e6bbd917 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:20.660157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9c21c-0d38-4bcf-bdbd-ace7cbeb6d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:20.660845 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9c21c-0d38-4bcf-bdbd-ace7cbeb6d19 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:20.661125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9c21c-0d38-4bcf-bdbd-ace7cbeb6d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:20.661464 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9c21c-0d38-4bcf-bdbd-ace7cbeb6d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:20.674465 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9c21c-0d38-4bcf-bdbd-ace7cbeb6d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:20.677326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9c21c-0d38-4bcf-bdbd-ace7cbeb6d19 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:20.693709 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 764/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:44:21.199497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:44:21.201160 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:44:21.215098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a652a-1020-4d19-be22-1d17fbae5212 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:44:21.220533 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:44:21.221433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:44:21.221951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:44:21.222161 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] PATH_INFO: `/v3/projects/de6405ebd1344de5a5cd8bafd186ca70` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:44:21.223607 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6405ebd1344de5a5cd8bafd186ca70)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:44:21.224736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:44:21.224736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:44:21.224736 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:44:21.227033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:44:21.312473 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6405ebd1344de5a5cd8bafd186ca70', 'request_id': 'req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:21.319934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6405ebd1344de5a5cd8bafd186ca70', 'request_id': 'req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:21.331728 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6405ebd1344de5a5cd8bafd186ca70', 'request_id': 'req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:21.356447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] The token cache is being invalidate because project de6405ebd1344de5a5cd8bafd186ca70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88074) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:44:21.356772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:21.357520 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-fa765df1-84b0-4ce8-96a8-f9fb0bf02c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:44:21.359101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 746/1510] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 09:44:21 2022] DELETE /identity/v3/projects/de6405ebd1344de5a5cd8bafd186ca70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:44:30.688625 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:31.351825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:37.565310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3019-b010-4c95-a4c2-446e7b6fe376 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:37.566266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3019-b010-4c95-a4c2-446e7b6fe376 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:37.566266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f3019-b010-4c95-a4c2-446e7b6fe376 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:37.567046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:45:37.573779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19660689-c19d-49af-bfba-546d49d2e26e None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:37.574372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19660689-c19d-49af-bfba-546d49d2e26e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:37.574372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19660689-c19d-49af-bfba-546d49d2e26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:37.596181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-19660689-c19d-49af-bfba-546d49d2e26e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:37.597491 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-19660689-c19d-49af-bfba-546d49d2e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:37.694936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:45:37.856822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3019-b010-4c95-a4c2-446e7b6fe376 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:45:37.858735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-af9f3019-b010-4c95-a4c2-446e7b6fe376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:37.978755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f3019-b010-4c95-a4c2-446e7b6fe376 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:45:37.985394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c5d00-9bed-48be-971f-9916c5f10f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:45:37.986026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c5d00-9bed-48be-971f-9916c5f10f21 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:37.986302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c5d00-9bed-48be-971f-9916c5f10f21 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:37.986577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c5d00-9bed-48be-971f-9916c5f10f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:37.997041 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c5d00-9bed-48be-971f-9916c5f10f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:45:37.998652 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c5d00-9bed-48be-971f-9916c5f10f21 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:45:38.009631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 766/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:45:39.215814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca7bf6-4308-4cff-8020-e17934dacc69 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:39.216559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca7bf6-4308-4cff-8020-e17934dacc69 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:39.216559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca7bf6-4308-4cff-8020-e17934dacc69 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:39.217840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:45:39.225023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3e94-153e-4c1c-9ccf-9847e1f754b2 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:39.225859 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3e94-153e-4c1c-9ccf-9847e1f754b2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:39.226035 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3e94-153e-4c1c-9ccf-9847e1f754b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:39.249964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-f69f3e94-153e-4c1c-9ccf-9847e1f754b2 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:39.251241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-f69f3e94-153e-4c1c-9ccf-9847e1f754b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:39.259633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:45:39.429169 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca7bf6-4308-4cff-8020-e17934dacc69 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:45:39.446829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca7bf6-4308-4cff-8020-e17934dacc69 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:45:39.453967 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864bf37-6856-4c32-8ba4-5f4e1353dcb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:45:39.454648 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864bf37-6856-4c32-8ba4-5f4e1353dcb0 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:39.454952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864bf37-6856-4c32-8ba4-5f4e1353dcb0 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:39.455320 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864bf37-6856-4c32-8ba4-5f4e1353dcb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:39.467572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864bf37-6856-4c32-8ba4-5f4e1353dcb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:45:39.470267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864bf37-6856-4c32-8ba4-5f4e1353dcb0 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:45:39.485139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 749/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:45:41.803012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b888ed-5ae3-44d3-b462-9892cb32bba7 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:41.803676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b888ed-5ae3-44d3-b462-9892cb32bba7 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:41.803847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b888ed-5ae3-44d3-b462-9892cb32bba7 None None] PATH_INFO: `/v3` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:41.806176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 768/1517] 10.222.0.50 () {54 vars in 925 bytes} [Fri Oct 28 09:45:41 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:45:41.813260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1d03-0213-4c1e-ad22-41a1205161a6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:41.814108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1d03-0213-4c1e-ad22-41a1205161a6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:41.814108 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc1d03-0213-4c1e-ad22-41a1205161a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:41.884537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-0dcc1d03-0213-4c1e-ad22-41a1205161a6 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:41.886123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-0dcc1d03-0213-4c1e-ad22-41a1205161a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:41.990780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 750/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Fri Oct 28 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:45:45.621111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d189935-d02c-4a77-a1be-e8d5c0bc018d None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:45.621878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d189935-d02c-4a77-a1be-e8d5c0bc018d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:45.622078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d189935-d02c-4a77-a1be-e8d5c0bc018d None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:45.623950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 769/1519] 10.222.0.44 () {54 vars in 961 bytes} [Fri Oct 28 09:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:45:45.631574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189613-0974-4a6a-9133-bb716770a714 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:45.632497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189613-0974-4a6a-9133-bb716770a714 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:45.632497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189613-0974-4a6a-9133-bb716770a714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:45.664419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-56189613-0974-4a6a-9133-bb716770a714 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:45.666382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-56189613-0974-4a6a-9133-bb716770a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:45.681285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 751/1520] 10.222.0.44 () {58 vars in 1058 bytes} [Fri Oct 28 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:45:45.690764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d189935-d02c-4a77-a1be-e8d5c0bc018d None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:45:45.707942 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d189935-d02c-4a77-a1be-e8d5c0bc018d None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:45:45.713235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43969e63-dc50-4f0e-ae46-4be19104cd1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:45:45.714559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43969e63-dc50-4f0e-ae46-4be19104cd1e service placement] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:45.714833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43969e63-dc50-4f0e-ae46-4be19104cd1e service placement] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:45.715105 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43969e63-dc50-4f0e-ae46-4be19104cd1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:45.724769 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43969e63-dc50-4f0e-ae46-4be19104cd1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:45:45.726406 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43969e63-dc50-4f0e-ae46-4be19104cd1e service placement] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:45:45.739752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 770/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:45:51.109807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2251-9e7e-47d9-bed9-189d4a36409e None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:51.110483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2251-9e7e-47d9-bed9-189d4a36409e None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:51.110483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2251-9e7e-47d9-bed9-189d4a36409e None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:51.111949 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:45:51.121883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dcdf5-a982-4fb5-b68c-523c30b06c77 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:51.122490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dcdf5-a982-4fb5-b68c-523c30b06c77 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:51.122490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dcdf5-a982-4fb5-b68c-523c30b06c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:51.145242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-7d0dcdf5-a982-4fb5-b68c-523c30b06c77 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:51.146758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7d0dcdf5-a982-4fb5-b68c-523c30b06c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:51.156361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:45:51.327876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2251-9e7e-47d9-bed9-189d4a36409e None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:45:51.344823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2251-9e7e-47d9-bed9-189d4a36409e None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:45:51.352451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531172ef-c40f-4a51-997a-a17bdcbdab0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:45:51.353104 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531172ef-c40f-4a51-997a-a17bdcbdab0c service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:51.353380 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531172ef-c40f-4a51-997a-a17bdcbdab0c service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:51.353649 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531172ef-c40f-4a51-997a-a17bdcbdab0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:51.365131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531172ef-c40f-4a51-997a-a17bdcbdab0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:45:51.366874 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531172ef-c40f-4a51-997a-a17bdcbdab0c service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:45:51.379704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 753/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:45:52.541478 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadda401-8b74-4c96-8a55-13ebaaf82923 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:52.542739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadda401-8b74-4c96-8a55-13ebaaf82923 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:52.542739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadda401-8b74-4c96-8a55-13ebaaf82923 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:52.544029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:45:52.551322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b81f-ebcc-46ec-b160-74a402a02a98 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:52.552627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b81f-ebcc-46ec-b160-74a402a02a98 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:52.552627 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b81f-ebcc-46ec-b160-74a402a02a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:52.574870 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-f900b81f-ebcc-46ec-b160-74a402a02a98 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:52.576101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f900b81f-ebcc-46ec-b160-74a402a02a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:52.584233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:45:52.744129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadda401-8b74-4c96-8a55-13ebaaf82923 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:45:52.760840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadda401-8b74-4c96-8a55-13ebaaf82923 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:45:52.767524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fcfc9-608b-43f8-b6f3-be9cc3368bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:45:52.768154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fcfc9-608b-43f8-b6f3-be9cc3368bff service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:52.768468 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fcfc9-608b-43f8-b6f3-be9cc3368bff service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:52.768744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fcfc9-608b-43f8-b6f3-be9cc3368bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:52.778753 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fcfc9-608b-43f8-b6f3-be9cc3368bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:45:52.780409 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fcfc9-608b-43f8-b6f3-be9cc3368bff service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:45:52.794017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 773/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:45:57.254724 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1faa6-62b7-4e0c-9bba-483eff2e4162 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:57.255428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1faa6-62b7-4e0c-9bba-483eff2e4162 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:57.255428 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1faa6-62b7-4e0c-9bba-483eff2e4162 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:57.256726 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:45:57.262603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772c14-f8a4-4e58-b02e-79cd8782edff None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:57.263181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772c14-f8a4-4e58-b02e-79cd8782edff None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:57.263181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772c14-f8a4-4e58-b02e-79cd8782edff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:57.284570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-0a772c14-f8a4-4e58-b02e-79cd8782edff None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:57.285871 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0a772c14-f8a4-4e58-b02e-79cd8782edff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:57.295013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:45:57.588512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1faa6-62b7-4e0c-9bba-483eff2e4162 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:45:57.591129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-17c1faa6-62b7-4e0c-9bba-483eff2e4162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:57.623764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:57.660049 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1faa6-62b7-4e0c-9bba-483eff2e4162 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:45:57.664099 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e6df-8814-429b-ae3a-4de6a29d7303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:45:57.664758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e6df-8814-429b-ae3a-4de6a29d7303 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:57.665040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e6df-8814-429b-ae3a-4de6a29d7303 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:57.665311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e6df-8814-429b-ae3a-4de6a29d7303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:57.676595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e6df-8814-429b-ae3a-4de6a29d7303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:45:57.678183 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e6df-8814-429b-ae3a-4de6a29d7303 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:45:57.690437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 756/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:45:59.951883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353dfcd-ce49-42ef-bb1e-9ae5f76f77cd None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:59.952496 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353dfcd-ce49-42ef-bb1e-9ae5f76f77cd None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:59.952725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353dfcd-ce49-42ef-bb1e-9ae5f76f77cd None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:59.954840 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:45:59.961106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6bac9-18c1-41a3-9760-343e8822690c None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:45:59.961643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6bac9-18c1-41a3-9760-343e8822690c None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:45:59.961764 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6bac9-18c1-41a3-9760-343e8822690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:45:59.984008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-2ce6bac9-18c1-41a3-9760-343e8822690c None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:45:59.985273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-2ce6bac9-18c1-41a3-9760-343e8822690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:45:59.994050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:46:00.332877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353dfcd-ce49-42ef-bb1e-9ae5f76f77cd None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:00.350386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353dfcd-ce49-42ef-bb1e-9ae5f76f77cd None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:00.356267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9008da5-7ffa-4c23-ab76-c8a1f886a2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:00.357148 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008da5-7ffa-4c23-ab76-c8a1f886a2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:00.357553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008da5-7ffa-4c23-ab76-c8a1f886a2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:00.357946 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9008da5-7ffa-4c23-ab76-c8a1f886a2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:00.372633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9008da5-7ffa-4c23-ab76-c8a1f886a2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:00.374911 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9008da5-7ffa-4c23-ab76-c8a1f886a2a6 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:00.391713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 776/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:04.648487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd6f8-7bbb-45fc-af86-645f4af9df32 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:04.648487 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd6f8-7bbb-45fc-af86-645f4af9df32 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:04.649233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd6f8-7bbb-45fc-af86-645f4af9df32 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:04.652028 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:46:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:04.658989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab4037-8083-4760-bcd0-87468c1fb31d None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:04.659795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab4037-8083-4760-bcd0-87468c1fb31d None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:04.659795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab4037-8083-4760-bcd0-87468c1fb31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:04.672376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=74 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:04.695119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-08ab4037-8083-4760-bcd0-87468c1fb31d None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:04.697241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-08ab4037-8083-4760-bcd0-87468c1fb31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:04.711628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:05.023219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afd6f8-7bbb-45fc-af86-645f4af9df32 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:05.025001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-93afd6f8-7bbb-45fc-af86-645f4af9df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:05.107851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afd6f8-7bbb-45fc-af86-645f4af9df32 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:05.111878 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed35c32-1066-43aa-86d3-5c9e17101e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b9ce9facf54e809bd8e569b27a6791', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:05.112606 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed35c32-1066-43aa-86d3-5c9e17101e63 service cinder] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:05.112883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed35c32-1066-43aa-86d3-5c9e17101e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:05.113159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed35c32-1066-43aa-86d3-5c9e17101e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:05.124852 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed35c32-1066-43aa-86d3-5c9e17101e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:05.126340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed35c32-1066-43aa-86d3-5c9e17101e63 service cinder] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:05.137795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 759/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:07.578741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82d51-1a15-43ac-9b79-5bb4ec7b8fb6 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:07.579315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82d51-1a15-43ac-9b79-5bb4ec7b8fb6 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:07.579555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82d51-1a15-43ac-9b79-5bb4ec7b8fb6 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:07.581676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:07.588233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a8658-1d56-4452-bcf4-14b67dcf2189 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:07.588944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a8658-1d56-4452-bcf4-14b67dcf2189 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:07.589098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a8658-1d56-4452-bcf4-14b67dcf2189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:07.612174 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-210a8658-1d56-4452-bcf4-14b67dcf2189 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:07.613470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-210a8658-1d56-4452-bcf4-14b67dcf2189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:07.622055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:46:07.934613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82d51-1a15-43ac-9b79-5bb4ec7b8fb6 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:07.937402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-a2f82d51-1a15-43ac-9b79-5bb4ec7b8fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:07.961121 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f82d51-1a15-43ac-9b79-5bb4ec7b8fb6 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:07.968835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a222a3-9e67-47f8-a242-090c14dc4cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b9ce9facf54e809bd8e569b27a6791', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:07.969893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a222a3-9e67-47f8-a242-090c14dc4cbe service cinder] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:07.970396 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a222a3-9e67-47f8-a242-090c14dc4cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:07.970880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a222a3-9e67-47f8-a242-090c14dc4cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:07.989178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a222a3-9e67-47f8-a242-090c14dc4cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:07.991822 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a222a3-9e67-47f8-a242-090c14dc4cbe service cinder] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:08.012419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 779/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:17.606930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=47 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:18.003656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=8 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:31.666231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcb7dd-4943-4de7-b19f-6e36b5dafbde None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.666851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcb7dd-4943-4de7-b19f-6e36b5dafbde None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.667185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcb7dd-4943-4de7-b19f-6e36b5dafbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.702779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-bcfcb7dd-4943-4de7-b19f-6e36b5dafbde None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:31.704118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-bcfcb7dd-4943-4de7-b19f-6e36b5dafbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:31.714361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 761/1540] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:31.726544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.727220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.727609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.756868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e51a3-0105-45e7-8587-94a3a4933731 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.757176 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e51a3-0105-45e7-8587-94a3a4933731 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.757448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e51a3-0105-45e7-8587-94a3a4933731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.762275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:31.764089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:31.778732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 780/1541] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:31.779861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-485e51a3-0105-45e7-8587-94a3a4933731 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:31.781118 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-485e51a3-0105-45e7-8587-94a3a4933731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:31.783609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:31.789707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 762/1542] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:31.794193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf0a3-046b-4f8a-9397-9fcac560243e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:31.799440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:31.799684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.799842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.800032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.800184 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.800360 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.800631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.801294 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88073) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:47:31.801600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:31.802704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:47:31.802704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:47:31.802704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:47:31.803531 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:31.826139 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 781/1543] 10.222.0.44 () {58 vars in 1153 bytes} [Fri Oct 28 09:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:47:31.826392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:31.826392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:31.828124 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:31.836900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 763/1544] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:31.844410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:31.853326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363830-9f41-4c5f-8eea-f0125dde15e4 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:31.856735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec792262-4569-48b8-b48d-0d715a79cf36 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:31.860868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:31.861497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.861824 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.861971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:31.862146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.862569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.862760 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:31.862914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.863273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.863947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88074) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:47:31.864285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:31.864770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:31.866111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:31.879278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 764/1545] 10.222.0.44 () {58 vars in 1153 bytes} [Fri Oct 28 09:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:47:31.888869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:31.900288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 782/1546] 10.222.0.44 () {60 vars in 1153 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:47:31.900634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5e24b-cc61-4a89-b1c2-a6182d963f4a admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:31.903038 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:31.967778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:31.968996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.969483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.969918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.971006 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:31.972339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:47:31.972339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:47:31.972339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:47:31.973794 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:31.974391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069f361-9bc6-4756-98be-c3230dee7c26 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:31.979578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:31.980213 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:31.981227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:31.981581 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:31.982249 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:31.983303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:47:31.983303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:47:31.983303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:47:31.984574 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.011910 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 783/1547] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:47:32.016950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.021654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 765/1548] 10.222.0.44 () {60 vars in 1153 bytes} [Fri Oct 28 09:47:31 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:47:32.027379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.030157 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf8a82-c8cb-471a-9a40-7378416f3d8f admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.124370 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.125158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.125383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888db92-55f0-4b1f-aef1-1314f76fe76e admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.125611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.126010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.126838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.128921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.131695 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.132538 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.132955 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.133364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.134282 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.137203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.141516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 784/1549] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:47:32.145914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.157707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599e9c-bf49-4638-b312-d6a26d63197e admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.162573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.163196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.163488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.167191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 766/1550] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:47:32 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:47:32.167333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.167333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.167333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.168743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.179059 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 785/1551] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:47:32.179484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2869-9c3d-4240-a5a0-5bdae619cadd admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.183309 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.184765 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.185525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.185841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.186119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.186790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.188738 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.194597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20462992-9e29-49c6-9a51-eff66ebb6e46 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.199676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadadceb-cb95-4409-b600-cb544266f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.200523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadadceb-cb95-4409-b600-cb544266f84c admin admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.200805 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadadceb-cb95-4409-b600-cb544266f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.201128 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadadceb-cb95-4409-b600-cb544266f84c admin admin] PATH_INFO: `/v3/projects/c8040fa5561746f1b136e4c9984eb5c9/users/95da6f9756ea4e4a848c8a5640b7c85f/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.201961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 767/1552] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:47:32.206541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.218685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6cd4-d836-4da3-8cda-6fd81241a767 admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.222092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadadceb-cb95-4409-b600-cb544266f84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8040fa5561746f1b136e4c9984eb5c9, user_id=95da6f9756ea4e4a848c8a5640b7c85f, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.223571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.224210 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.224563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.224819 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.225457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.226162 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadadceb-cb95-4409-b600-cb544266f84c admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.227382 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.242335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 768/1553] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:47:32.246865 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.248328 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 786/1554] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:47:32 2022] PUT /identity/v3/projects/c8040fa5561746f1b136e4c9984eb5c9/users/95da6f9756ea4e4a848c8a5640b7c85f/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:47:32.249930 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.250267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.250550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.258458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6bb41-d3bc-4814-9f63-4e37641e7466 admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.272373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:32.273640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:32.278623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:32.282746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:32.332723 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.333594 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.333773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.334002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] PATH_INFO: `/v3/projects/8642f357111144039791e597c6668f7b/users/cdf40eba6a514d18b7e1c2b4acda97c7/roles/1d69c101c31d486496fd3165551273f4` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.351654 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 787/1555] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:32.351948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8642f357111144039791e597c6668f7b, user_id=cdf40eba6a514d18b7e1c2b4acda97c7, role_id=1d69c101c31d486496fd3165551273f4)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.352999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:47:32.352999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:47:32.352999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:47:32.355095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76124935-acd7-4a8a-a843-13a02a6f3e96 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.364275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.365886 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:32.375680 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 769/1556] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:47:32 2022] PUT /identity/v3/projects/8642f357111144039791e597c6668f7b/users/cdf40eba6a514d18b7e1c2b4acda97c7/roles/1d69c101c31d486496fd3165551273f4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:47:32.381078 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.381375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.381634 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.403134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] MFA Rules not processed for user `094fba2382e149f9b3e5ba2c3c144f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:32.404833 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:32.441858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6054db-1dc6-45ba-9fcd-875147f4d7ac None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.478512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 770/1557] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:32.493484 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:32.507364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f252ef8-232b-49de-963c-312fd263679a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.508004 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f252ef8-232b-49de-963c-312fd263679a service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.508344 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f252ef8-232b-49de-963c-312fd263679a service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.508593 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f252ef8-232b-49de-963c-312fd263679a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.520900 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f252ef8-232b-49de-963c-312fd263679a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.522896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f252ef8-232b-49de-963c-312fd263679a service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.534787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 788/1558] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:47:32.592499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31b100-34f2-4ebe-a6c0-ed0e4152e508 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:32.599524 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:32.600729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:32.601237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:32.601800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:32.620085 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:32.623287 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:32.642278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 771/1559] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:38.648466 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:38.649460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:38.649909 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:38.709752 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] MFA Rules not processed for user `95da6f9756ea4e4a848c8a5640b7c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:38.712545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:38.850915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:38.872432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 789/1560] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:38.877289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:38.890391 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde47dc9-9610-459a-9f6a-61a3104b63ca service neutron] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:38.897032 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:38.897730 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:38.897987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:38.898259 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] PATH_INFO: `/v3/projects` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:38.898944 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:38.901569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:38.963834 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:38.975883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 772/1561] 10.222.0.44 () {60 vars in 1153 bytes} [Fri Oct 28 09:47:38 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:47:38.979542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2143-2a64-4bf7-ab91-835766982eef None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:39.101517 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:39.102195 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:39.102474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:39.102838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] PATH_INFO: `/v3/users` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:39.103541 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:39.107027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:39.145969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:39.146407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 790/1562] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:47:38 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:47:39.167248 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa37a-dfb5-468c-a050-a79cb88d8825 admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:39.174506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:39.175616 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:39.176069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:39.176660 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:39.177965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:39.180544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:39.204708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 773/1563] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:47:39.212260 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:39.247053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9ccb-ad73-45ee-bc09-104ac55a3453 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:39.260368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:39.261293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:39.261554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:39.262117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] PATH_INFO: `/v3/projects/872895ce1c824224999f44785e1f0f1f/users/d4a6ecaa988247de8ffdc61124fb87db/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:39.284829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872895ce1c824224999f44785e1f0f1f, user_id=d4a6ecaa988247de8ffdc61124fb87db, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:39.289119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:39.313640 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 791/1564] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:47:39 2022] PUT /identity/v3/projects/872895ce1c824224999f44785e1f0f1f/users/d4a6ecaa988247de8ffdc61124fb87db/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:47:39.315241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:39.330123 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568e9c-7df0-4dd8-ba1e-bceee298c9db admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:39.343653 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:39.415430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fb944-f3ae-4299-a982-400309b0cb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:39.416146 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb944-f3ae-4299-a982-400309b0cb9b admin admin] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:39.416525 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb944-f3ae-4299-a982-400309b0cb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:39.416830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb944-f3ae-4299-a982-400309b0cb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:39.417596 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb944-f3ae-4299-a982-400309b0cb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:39.419823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb944-f3ae-4299-a982-400309b0cb9b admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:39.441154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 774/1565] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:47:39.445244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:39.461267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527b76-d12c-401b-b1d1-3e11c5cb77b0 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:39.469280 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:39.470094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] REQUEST_METHOD: `PUT` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:39.470402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:39.470854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] PATH_INFO: `/v3/projects/872895ce1c824224999f44785e1f0f1f/users/d4a6ecaa988247de8ffdc61124fb87db/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:39.473243 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872895ce1c824224999f44785e1f0f1f, user_id=d4a6ecaa988247de8ffdc61124fb87db, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:39.476193 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:39.500904 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 792/1566] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:47:39 2022] PUT /identity/v3/projects/872895ce1c824224999f44785e1f0f1f/users/d4a6ecaa988247de8ffdc61124fb87db/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:47:40.804102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:40.804646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:40.804767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:40.896047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:40.897379 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:41.070053 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 775/1567] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:41.080553 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:41.251898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4e85-10cc-4372-95c0-66324c461712 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:41.257659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:41.258372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:41.258780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:41.259094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:41.259862 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:41.262585 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:41.321357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 793/1568] 10.222.0.44 () {60 vars in 1153 bytes} [Fri Oct 28 09:47:41 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:47:41.326303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:41.348164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c5b9-836b-4d17-a38e-384bd745e420 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:41.498336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:41.499033 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:41.499311 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:41.499783 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] PATH_INFO: `/v3/users` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:41.500288 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:41.502686 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:41.567356 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 776/1569] 10.222.0.44 () {60 vars in 1144 bytes} [Fri Oct 28 09:47:41 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:47:41.574215 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:41.607289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee188ff-9102-40bb-b672-c4ed6f59ea55 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:41.628055 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:41.629301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:41.629872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:41.630555 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:41.633112 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:41.636492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:41.663377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 794/1570] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:47:41.668645 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:41.687429 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6bf5-36dd-4f52-a202-2c9b7140661d admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:41.697201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:41.698521 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:41.699015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:41.700497 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] PATH_INFO: `/v3/projects/5ca33e7fd59e4b3899a3a03a1502a8fc/users/3f278ffde64c4e598f30e24da90dc30f/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:41.736097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca33e7fd59e4b3899a3a03a1502a8fc, user_id=3f278ffde64c4e598f30e24da90dc30f, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:41.741583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:41.775385 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 777/1571] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:47:41 2022] PUT /identity/v3/projects/5ca33e7fd59e4b3899a3a03a1502a8fc/users/3f278ffde64c4e598f30e24da90dc30f/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:47:41.781315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:41.810358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cca3-056d-4ad4-9b10-bbadf70e2ff8 admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:41.891939 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:42.060914 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886aa37-5cc2-4edd-b644-ae3d3f77a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:42.061564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886aa37-5cc2-4edd-b644-ae3d3f77a410 admin admin] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:42.061846 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886aa37-5cc2-4edd-b644-ae3d3f77a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:42.063523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886aa37-5cc2-4edd-b644-ae3d3f77a410 admin admin] PATH_INFO: `/v3/roles` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:42.064265 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886aa37-5cc2-4edd-b644-ae3d3f77a410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:42.066086 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886aa37-5cc2-4edd-b644-ae3d3f77a410 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:42.079981 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 795/1572] 10.222.0.44 () {58 vars in 1122 bytes} [Fri Oct 28 09:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:47:42.084273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:42.097633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:42.102725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af6cae-5df3-4960-b874-dc2e449f854e admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:42.122375 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:42.123806 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] REQUEST_METHOD: `PUT` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:42.124267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:42.124622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] PATH_INFO: `/v3/projects/5ca33e7fd59e4b3899a3a03a1502a8fc/users/3f278ffde64c4e598f30e24da90dc30f/roles/ffaa531437c44d74a7c49f5c86f516ca` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:42.138844 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca33e7fd59e4b3899a3a03a1502a8fc, user_id=3f278ffde64c4e598f30e24da90dc30f, role_id=ffaa531437c44d74a7c49f5c86f516ca)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:42.142778 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:42.174475 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 778/1573] 10.222.0.44 () {60 vars in 1483 bytes} [Fri Oct 28 09:47:42 2022] PUT /identity/v3/projects/5ca33e7fd59e4b3899a3a03a1502a8fc/users/3f278ffde64c4e598f30e24da90dc30f/roles/ffaa531437c44d74a7c49f5c86f516ca => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:47:47.282978 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786c5e-fef6-4880-a862-f2c60924f860 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:47.283888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786c5e-fef6-4880-a862-f2c60924f860 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:47.283888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786c5e-fef6-4880-a862-f2c60924f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:47.320398 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-89786c5e-fef6-4880-a862-f2c60924f860 None None] MFA Rules not processed for user `d4a6ecaa988247de8ffdc61124fb87db`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:47.322214 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-89786c5e-fef6-4880-a862-f2c60924f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:47.467889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 796/1574] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:47.471050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:47.473918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:47.714256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359ff6b-9689-4238-9918-ec21fd946630 admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:47.722140 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3233db58d77647ba9687c8d51a427eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:47.723326 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:47.724749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:47.725317 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:47.871137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:47.875507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:47.903987 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 779/1575] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:47:48.326332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8253e1-f725-4b0d-97b4-5e7645c23e0c None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:48.326884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8253e1-f725-4b0d-97b4-5e7645c23e0c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:48.326884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8253e1-f725-4b0d-97b4-5e7645c23e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:48.498072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-7f8253e1-f725-4b0d-97b4-5e7645c23e0c None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:48.499719 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-7f8253e1-f725-4b0d-97b4-5e7645c23e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:48.713952 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 797/1576] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:47:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:48.846223 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:48.849152 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:49.028407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf7070-6383-4289-ab59-3abe08c664da service glance] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:49.036732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:49.037921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:49.038671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:49.039114 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:49.058373 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:49.066973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:49.069397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:49.099325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 780/1577] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:47:51.110336 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb65b0-43dd-4e98-bae5-4decbf249362 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:51.112197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb65b0-43dd-4e98-bae5-4decbf249362 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:51.112948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb65b0-43dd-4e98-bae5-4decbf249362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:51.187269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-63cb65b0-43dd-4e98-bae5-4decbf249362 None None] MFA Rules not processed for user `3f278ffde64c4e598f30e24da90dc30f`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:51.191232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-63cb65b0-43dd-4e98-bae5-4decbf249362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:51.204838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:51.367843 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 798/1578] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:51.399857 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:51.417413 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fd3e-dc3f-49c2-a50a-bb5cdcd177dd service swift] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:51.432842 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3233db58d77647ba9687c8d51a427eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:51.433659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:51.434755 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:51.435070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:51.637454 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:51.639722 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:51.662812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 781/1579] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:54.584699 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3be1-d9ab-462e-ac79-a1cf529954b5 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.585342 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3be1-d9ab-462e-ac79-a1cf529954b5 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.585692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3be1-d9ab-462e-ac79-a1cf529954b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.688529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c63b3be1-d9ab-462e-ac79-a1cf529954b5 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:54.691289 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c63b3be1-d9ab-462e-ac79-a1cf529954b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:54.706989 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 799/1580] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:54.721734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:54.742486 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba8ed-5161-4056-b525-65bedb81f4d7 service glance] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:54.758402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fc274-05d2-4c36-8267-d70040f60580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:54.759554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc274-05d2-4c36-8267-d70040f60580 service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.760095 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc274-05d2-4c36-8267-d70040f60580 service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.760690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc274-05d2-4c36-8267-d70040f60580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.782962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fc274-05d2-4c36-8267-d70040f60580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:54.787507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fc274-05d2-4c36-8267-d70040f60580 service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:54.809125 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 782/1581] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:47:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:48:03.968729 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1fc-520a-4a47-981b-9fd2d64e7dfe None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:03.969358 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1fc-520a-4a47-981b-9fd2d64e7dfe None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:03.969471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1fc-520a-4a47-981b-9fd2d64e7dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:03.990272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-0c19a1fc-520a-4a47-981b-9fd2d64e7dfe None None] MFA Rules not processed for user `95da6f9756ea4e4a848c8a5640b7c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:03.991483 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-0c19a1fc-520a-4a47-981b-9fd2d64e7dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:04.000808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 800/1582] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:48:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:48:04.321557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a783b-77a8-4f36-a031-1966c4f81aa2 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:04.322451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a783b-77a8-4f36-a031-1966c4f81aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:04.322614 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a783b-77a8-4f36-a031-1966c4f81aa2 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:04.324080 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 783/1583] 10.222.0.44 () {54 vars in 960 bytes} [Fri Oct 28 09:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:04.329983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172239-6ab1-4adb-8aed-48d8cddd5420 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:04.330275 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172239-6ab1-4adb-8aed-48d8cddd5420 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:04.330575 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172239-6ab1-4adb-8aed-48d8cddd5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:04.374438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-ab172239-6ab1-4adb-8aed-48d8cddd5420 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:04.375662 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-ab172239-6ab1-4adb-8aed-48d8cddd5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:04.454990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 801/1584] 10.222.0.44 () {58 vars in 1057 bytes} [Fri Oct 28 09:48:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:04.461013 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12e3d3-f9f9-4378-8910-598f99a71dde None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:04.461450 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12e3d3-f9f9-4378-8910-598f99a71dde None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:04.461879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12e3d3-f9f9-4378-8910-598f99a71dde None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:04.463452 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 784/1585] 10.222.0.44 () {54 vars in 912 bytes} [Fri Oct 28 09:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:04.470830 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7add6-03b4-4dc0-87ee-b0acef0a75e5 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:04.471305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7add6-03b4-4dc0-87ee-b0acef0a75e5 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:04.471780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7add6-03b4-4dc0-87ee-b0acef0a75e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:04.497234 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-48a7add6-03b4-4dc0-87ee-b0acef0a75e5 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:04.499186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-48a7add6-03b4-4dc0-87ee-b0acef0a75e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:04.510040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 802/1586] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:48:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:04.526362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12e3d3-f9f9-4378-8910-598f99a71dde None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:04.528861 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ec12e3d3-f9f9-4378-8910-598f99a71dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:04.543145 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12e3d3-f9f9-4378-8910-598f99a71dde None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:04.548609 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdf1d0-959c-4734-83bd-65cb738f8bca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3233db58d77647ba9687c8d51a427eb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:04.549431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdf1d0-959c-4734-83bd-65cb738f8bca service glance] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:04.549797 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdf1d0-959c-4734-83bd-65cb738f8bca service glance] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:04.550186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdf1d0-959c-4734-83bd-65cb738f8bca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:04.562772 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdf1d0-959c-4734-83bd-65cb738f8bca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:04.564427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdf1d0-959c-4734-83bd-65cb738f8bca service glance] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:04.578332 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 785/1587] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:04.998673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4b4a-3675-4b1c-9028-51c5a8369c9c None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:04.999228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4b4a-3675-4b1c-9028-51c5a8369c9c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:04.999446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4b4a-3675-4b1c-9028-51c5a8369c9c None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.001153 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 803/1588] 10.222.0.44 () {54 vars in 912 bytes} [Fri Oct 28 09:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:05.007284 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c599e-a219-497c-87dc-bb05460554dd None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.007564 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c599e-a219-497c-87dc-bb05460554dd None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.007867 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c599e-a219-497c-87dc-bb05460554dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.055126 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-454c599e-a219-497c-87dc-bb05460554dd None None] MFA Rules not processed for user `828e306d81f64846b2b8f07b3dd1e5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:05.056646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-454c599e-a219-497c-87dc-bb05460554dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:05.140597 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 786/1589] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:48:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:05.155273 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4b4a-3675-4b1c-9028-51c5a8369c9c None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:05.167855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4b4a-3675-4b1c-9028-51c5a8369c9c None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:05.176808 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45023b-dd82-4bd5-98f2-70b8e735cfcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:05.177725 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45023b-dd82-4bd5-98f2-70b8e735cfcd service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.178185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45023b-dd82-4bd5-98f2-70b8e735cfcd service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.178767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45023b-dd82-4bd5-98f2-70b8e735cfcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.193012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45023b-dd82-4bd5-98f2-70b8e735cfcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:05.194858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45023b-dd82-4bd5-98f2-70b8e735cfcd service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:05.205735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 804/1590] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:48:05.646671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf442-0546-4d40-86c2-52b9352f1a34 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.647501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf442-0546-4d40-86c2-52b9352f1a34 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.647501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf442-0546-4d40-86c2-52b9352f1a34 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.648758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 787/1591] 10.222.0.44 () {54 vars in 960 bytes} [Fri Oct 28 09:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:05.657542 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89a30-dff7-4b82-8cb3-505b39aa54f8 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.658142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89a30-dff7-4b82-8cb3-505b39aa54f8 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.658694 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d89a30-dff7-4b82-8cb3-505b39aa54f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.679203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bf442-0546-4d40-86c2-52b9352f1a34 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:05.685362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-59d89a30-dff7-4b82-8cb3-505b39aa54f8 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:05.686732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-59d89a30-dff7-4b82-8cb3-505b39aa54f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:05.697963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 805/1592] 10.222.0.44 () {58 vars in 1057 bytes} [Fri Oct 28 09:48:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:05.704896 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01d46-f73e-4115-bc1b-260f76762492 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.705191 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01d46-f73e-4115-bc1b-260f76762492 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.705448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01d46-f73e-4115-bc1b-260f76762492 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.707187 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 806/1593] 10.222.0.44 () {54 vars in 912 bytes} [Fri Oct 28 09:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:05.713134 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.713672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.714012 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.739554 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:05.740925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:05.751869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 807/1594] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:48:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:48:05.770119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:05.779471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bf442-0546-4d40-86c2-52b9352f1a34 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:05.791938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da44d3-a234-4adc-922f-67dcad570afd None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:05.792789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:05.794168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.794168 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.794489 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.796656 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:05.801395 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:05.802810 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:05.803447 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:05.804493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:05.806338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=100 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:05.826839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:05.826839 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b04b9-fdb3-4508-92ad-f57053673570 service placement] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:05.829566 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:05.830858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:05.835047 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 788/1595] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:48:05.855697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 808/1596] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:07.887096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde28d-6438-430d-8332-5e3d268202c9 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:07.887096 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde28d-6438-430d-8332-5e3d268202c9 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:07.888131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde28d-6438-430d-8332-5e3d268202c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:07.917127 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-74bde28d-6438-430d-8332-5e3d268202c9 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:07.919717 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-74bde28d-6438-430d-8332-5e3d268202c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:07.932150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 789/1597] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:48:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:07.966713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:07.979528 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485598c-f645-4844-be75-743beaac52ab service neutron] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:07.985814 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:07.987549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:07.987879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:07.988082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:07.998790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:08.000460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:08.009535 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 809/1598] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:48:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:48:17.910917 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=6 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:18.006011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=96 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:24.769692 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1fd5-c7d5-4ea3-9eea-227770eab2a6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:24.770560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1fd5-c7d5-4ea3-9eea-227770eab2a6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:24.770560 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c1fd5-c7d5-4ea3-9eea-227770eab2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:24.794424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-d79c1fd5-c7d5-4ea3-9eea-227770eab2a6 None None] MFA Rules not processed for user `828e306d81f64846b2b8f07b3dd1e5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:24.795964 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-d79c1fd5-c7d5-4ea3-9eea-227770eab2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:24.804150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 790/1599] 10.222.0.50 () {58 vars in 1015 bytes} [Fri Oct 28 09:48:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:24.817098 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:24.834209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598798-8feb-4e3a-b655-7fab9c82df9e service swift] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:24.837298 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0b617-aeaf-4183-aced-2dc4d96f5a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:24.838372 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0b617-aeaf-4183-aced-2dc4d96f5a4c service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:24.838835 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0b617-aeaf-4183-aced-2dc4d96f5a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:24.839303 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0b617-aeaf-4183-aced-2dc4d96f5a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:24.858376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0b617-aeaf-4183-aced-2dc4d96f5a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:24.861221 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0b617-aeaf-4183-aced-2dc4d96f5a4c service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:24.878318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 810/1600] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:25.833590 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d161-0700-4ccd-b626-07fa44b67488 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:25.834451 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d161-0700-4ccd-b626-07fa44b67488 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:25.834856 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d161-0700-4ccd-b626-07fa44b67488 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:25.836628 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 791/1601] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:25.885046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c04b6-716a-4b72-8036-ad10ffba8ce0 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:25.885912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c04b6-716a-4b72-8036-ad10ffba8ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:25.885912 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c04b6-716a-4b72-8036-ad10ffba8ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:25.913693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-093c04b6-716a-4b72-8036-ad10ffba8ce0 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:25.915365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-093c04b6-716a-4b72-8036-ad10ffba8ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:25.925931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 811/1602] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:48:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:25.957043 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d161-0700-4ccd-b626-07fa44b67488 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:25.974345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d161-0700-4ccd-b626-07fa44b67488 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:25.982444 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4836716-8cb8-40c1-bb33-3f803663c45f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:25.983261 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836716-8cb8-40c1-bb33-3f803663c45f service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:25.983567 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836716-8cb8-40c1-bb33-3f803663c45f service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:25.983962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4836716-8cb8-40c1-bb33-3f803663c45f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:25.996586 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4836716-8cb8-40c1-bb33-3f803663c45f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:25.998735 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4836716-8cb8-40c1-bb33-3f803663c45f service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:26.010877 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 792/1603] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:32.345799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0494b-9a2e-4151-ab63-cfdf3275645e None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.346321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0494b-9a2e-4151-ab63-cfdf3275645e None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.346321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0494b-9a2e-4151-ab63-cfdf3275645e None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.347746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 812/1604] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:48:32.378693 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84575b88-0eaa-4e63-9be5-6fe518c3c0b6 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.379504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84575b88-0eaa-4e63-9be5-6fe518c3c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.379504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84575b88-0eaa-4e63-9be5-6fe518c3c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.406948 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-84575b88-0eaa-4e63-9be5-6fe518c3c0b6 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:32.408186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-84575b88-0eaa-4e63-9be5-6fe518c3c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:32.417947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 793/1605] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:48:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:32.442678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0494b-9a2e-4151-ab63-cfdf3275645e None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:32.458815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0494b-9a2e-4151-ab63-cfdf3275645e None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:32.464366 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:32.464990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.465269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.465534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.476011 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:32.477671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:32.489715 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 813/1606] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:42.401071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=12 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:42.484749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=15 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:49.047165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa789-a587-48fa-a2c0-8c7f6535bd18 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:49.047763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa789-a587-48fa-a2c0-8c7f6535bd18 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:49.047763 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa789-a587-48fa-a2c0-8c7f6535bd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:49.068277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-26caa789-a587-48fa-a2c0-8c7f6535bd18 None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:49.069529 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-26caa789-a587-48fa-a2c0-8c7f6535bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:49.078474 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 794/1607] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:48:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:57.995510 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:58.015622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d1d1-286f-49b3-b237-1c75cd069c54 service nova] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:58.021721 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8481619-1980-4181-a080-2849d4047506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:58.022795 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8481619-1980-4181-a080-2849d4047506 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:58.023293 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8481619-1980-4181-a080-2849d4047506 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:58.023787 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8481619-1980-4181-a080-2849d4047506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:58.043362 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8481619-1980-4181-a080-2849d4047506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:58.046563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8481619-1980-4181-a080-2849d4047506 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:58.065600 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 814/1608] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:48:59.062209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:00.541241 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6924a6-36dd-4459-b4cc-ef9f59272ac7 None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:00.542256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6924a6-36dd-4459-b4cc-ef9f59272ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:00.542256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6924a6-36dd-4459-b4cc-ef9f59272ac7 None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:00.545689 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 795/1609] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:49:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:00.555384 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c00ece-eaea-45cf-b8e9-6ce1ebca90a6 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:00.556173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c00ece-eaea-45cf-b8e9-6ce1ebca90a6 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:00.556441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c00ece-eaea-45cf-b8e9-6ce1ebca90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:00.594335 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-d4c00ece-eaea-45cf-b8e9-6ce1ebca90a6 None None] MFA Rules not processed for user `7b34a8c7d4f242c3a5be691db48cc0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:00.598544 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-d4c00ece-eaea-45cf-b8e9-6ce1ebca90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:00.620272 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 815/1610] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:49:00.647481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6924a6-36dd-4459-b4cc-ef9f59272ac7 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:00.687993 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6924a6-36dd-4459-b4cc-ef9f59272ac7 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:00.700302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6e524-9eb1-4547-a254-2bee98e83869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:00.702790 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6e524-9eb1-4547-a254-2bee98e83869 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:00.703826 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6e524-9eb1-4547-a254-2bee98e83869 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:00.704782 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6e524-9eb1-4547-a254-2bee98e83869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:00.739119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6e524-9eb1-4547-a254-2bee98e83869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:00.746357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6e524-9eb1-4547-a254-2bee98e83869 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:00.780647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 796/1611] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:10.584931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=9 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:10.772185 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=6 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:45.246704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:45.247318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:45.247318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:45.267430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:45.268704 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:45.275569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 816/1612] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:49:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:45.619697 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab701-1ffe-4238-af6b-1668283dde09 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:45.620598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab701-1ffe-4238-af6b-1668283dde09 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:45.620598 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab701-1ffe-4238-af6b-1668283dde09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:45.646950 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-139ab701-1ffe-4238-af6b-1668283dde09 None None] MFA Rules not processed for user `828e306d81f64846b2b8f07b3dd1e5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:45.648197 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-139ab701-1ffe-4238-af6b-1668283dde09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:45.656226 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 797/1613] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:49:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:45.667767 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:45.677972 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b13bcf-3872-4130-b3cc-018fd8af9503 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:45.681492 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:45.682094 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:45.682364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:45.682629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:45.690365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:45.691780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:45.700231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 817/1614] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:55.635962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:55.696151 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=9 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:05.075893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62712038-4953-4f0e-bd24-7b77b01d2662 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.076438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62712038-4953-4f0e-bd24-7b77b01d2662 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.076536 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62712038-4953-4f0e-bd24-7b77b01d2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.097331 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-62712038-4953-4f0e-bd24-7b77b01d2662 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:05.098563 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-62712038-4953-4f0e-bd24-7b77b01d2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:05.105749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 798/1615] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:05.148374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:05.162040 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207af3f9-bd40-451e-b9c5-9ab3cd969c9e service neutron] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:05.167310 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874194b-476d-4c6d-9b90-615ee6388d3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:05.168026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874194b-476d-4c6d-9b90-615ee6388d3f service swift] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:05.168203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874194b-476d-4c6d-9b90-615ee6388d3f service swift] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:05.168570 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874194b-476d-4c6d-9b90-615ee6388d3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:05.178603 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874194b-476d-4c6d-9b90-615ee6388d3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:05.180203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874194b-476d-4c6d-9b90-615ee6388d3f service swift] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:05.189659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 818/1616] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:10.585220 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:10.585741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:10.585828 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:10.605545 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:10.606749 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:10.614365 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 799/1617] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:15.185339 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=6 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:20.599990 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=6 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:42.237381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3fca4-8075-43f9-9872-ed311cc26279 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.237971 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3fca4-8075-43f9-9872-ed311cc26279 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.238076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3fca4-8075-43f9-9872-ed311cc26279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.260164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-69d3fca4-8075-43f9-9872-ed311cc26279 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:42.261499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-69d3fca4-8075-43f9-9872-ed311cc26279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:42.269437 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 819/1618] 10.222.0.44 () {58 vars in 967 bytes} [Fri Oct 28 09:50:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:42.287244 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:42.300419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19652a6f-cea4-46a8-9cb3-2e8d1989945b None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:42.305920 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27f84-90ad-4a36-a6b8-546beef04c50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:42.306623 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27f84-90ad-4a36-a6b8-546beef04c50 service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:42.306915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27f84-90ad-4a36-a6b8-546beef04c50 service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:42.307201 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27f84-90ad-4a36-a6b8-546beef04c50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:42.317228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b27f84-90ad-4a36-a6b8-546beef04c50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:42.318841 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b27f84-90ad-4a36-a6b8-546beef04c50 service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:42.327799 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 800/1619] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:50:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:46.982992 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a21be-c667-4498-8c6e-aad74de1c5e9 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:46.985345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a21be-c667-4498-8c6e-aad74de1c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:46.985345 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a21be-c667-4498-8c6e-aad74de1c5e9 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:46.985884 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 820/1620] 10.222.0.44 () {54 vars in 961 bytes} [Fri Oct 28 09:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:50:46.992430 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a44c-c122-44ab-b7ef-61e8ea672670 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:46.993231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a44c-c122-44ab-b7ef-61e8ea672670 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:46.993397 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52a44c-c122-44ab-b7ef-61e8ea672670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:47.014963 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-9b52a44c-c122-44ab-b7ef-61e8ea672670 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:50:47.016470 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9b52a44c-c122-44ab-b7ef-61e8ea672670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:50:47.026516 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 801/1621] 10.222.0.44 () {58 vars in 1058 bytes} [Fri Oct 28 09:50:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:50:47.035235 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a21be-c667-4498-8c6e-aad74de1c5e9 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:50:47.050286 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a21be-c667-4498-8c6e-aad74de1c5e9 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:50:47.056559 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:50:47.057186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:50:47.057469 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:50:47.057744 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:50:47.067417 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:50:47.069069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:50:47.083860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 821/1622] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:50:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:57.009181 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=9 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:57.077629 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=9 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:04.434866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:04.435431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:04.435431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:04.455919 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:04.457209 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:04.464368 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 802/1623] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:51:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:51:14.449776 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=3 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:22.554158 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:22.565969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1b23d-80f7-4ef4-9f5f-c3e26c5b8855 service placement] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:22.569893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:22.570506 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:22.570788 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:22.571064 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:22.581935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:22.583377 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:22.594002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 822/1624] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:32.589440 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=6 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:07.602062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:07.615983 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8fede-d8cb-46ba-b60c-ba6a292f20ef None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:07.621885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:07.622500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:07.622781 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:07.623050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:07.631743 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:07.633424 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:07.642432 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 803/1625] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:07.692739 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:07.701070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0dc10-51ef-4821-9fe7-4d1bab08307e service neutron] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:07.704572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8798b50-f558-40d6-b141-76adfcc3d4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:07.705159 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798b50-f558-40d6-b141-76adfcc3d4fa service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:07.705434 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798b50-f558-40d6-b141-76adfcc3d4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:07.705711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798b50-f558-40d6-b141-76adfcc3d4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:07.716480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8798b50-f558-40d6-b141-76adfcc3d4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:07.717891 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8798b50-f558-40d6-b141-76adfcc3d4fa service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:07.728779 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 823/1626] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:13.706488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:13.716401 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4eb3e-3e54-4fa5-aa6f-0dec5fcfc827 service nova] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:13.720155 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:13.720789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:13.721076 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:13.721353 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:13.732548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:13.733999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:13.745399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 804/1627] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:16.092537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc68f-719f-4573-9e79-d8a33512037c None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:16.093017 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc68f-719f-4573-9e79-d8a33512037c None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:16.093107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc68f-719f-4573-9e79-d8a33512037c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:16.114357 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-c31bc68f-719f-4573-9e79-d8a33512037c None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:16.115568 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c31bc68f-719f-4573-9e79-d8a33512037c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:16.123441 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 824/1628] 10.222.0.44 () {58 vars in 967 bytes} [Fri Oct 28 09:53:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:16.170403 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:16.182170 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a449-6308-4565-b928-1b95598b71e2 service neutron] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:16.187069 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:16.187678 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:16.187959 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:16.188233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:16.197071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:16.198647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:16.206663 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 805/1629] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:53:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:16.715101 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26d93d-1034-45f4-a822-121b86aa2da4 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:16.715393 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26d93d-1034-45f4-a822-121b86aa2da4 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:16.715675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26d93d-1034-45f4-a822-121b86aa2da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:16.736000 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-4b26d93d-1034-45f4-a822-121b86aa2da4 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:16.737488 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-4b26d93d-1034-45f4-a822-121b86aa2da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:16.745216 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 825/1630] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:53:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:16.758179 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:16.771936 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b2974-0876-42ac-bb02-8ee1aaf9ec25 service swift] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:16.777913 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:16.778530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:16.778815 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:16.779092 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:16.788676 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:16.790277 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:16.798522 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 806/1631] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:53:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:25.465131 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ebda1-fc25-4661-8e4f-054cc1edd582 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:25.465847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ebda1-fc25-4661-8e4f-054cc1edd582 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:25.465847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ebda1-fc25-4661-8e4f-054cc1edd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:25.488758 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-a59ebda1-fc25-4661-8e4f-054cc1edd582 None None] MFA Rules not processed for user `95da6f9756ea4e4a848c8a5640b7c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:25.489977 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-a59ebda1-fc25-4661-8e4f-054cc1edd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:25.502102 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 826/1632] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:26.217938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:26.232490 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f32b00-429b-44d2-98e5-d9e2abab22c9 service swift] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:26.240480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:26.241119 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:26.241399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:26.241713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:26.251673 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:26.253626 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:26.268571 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 807/1633] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:27.683860 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:27.684431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:27.684431 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:27.706999 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:27.708266 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:27.715965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 827/1634] 10.222.0.44 () {58 vars in 1009 bytes} [Fri Oct 28 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:27.729067 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:27.741646 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7da97-abd6-4169-9cc0-2c4e15c7d46d service placement] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:27.746754 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:27.747407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:27.747866 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:27.748141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:27.758103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:27.759633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:27.769855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 808/1635] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:53:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:37.701480 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=18 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:37.765549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=36 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:38.318915 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:38.330973 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90cd6c-1284-4db9-9b0c-421c15fcc1b2 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:38.337233 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:38.338329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:38.338869 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:38.339381 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:38.353573 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:38.356462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:38.369164 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 828/1636] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:39.073070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:39.108175 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4925f9b-7420-4c70-895a-c8c5e1252f46 service swift] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:39.121504 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902fc8-04e1-498c-a853-5734e0d6542c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:39.121759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902fc8-04e1-498c-a853-5734e0d6542c service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:39.122276 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902fc8-04e1-498c-a853-5734e0d6542c service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:39.122816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902fc8-04e1-498c-a853-5734e0d6542c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:39.143798 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902fc8-04e1-498c-a853-5734e0d6542c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:39.147569 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902fc8-04e1-498c-a853-5734e0d6542c service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:39.169419 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 809/1637] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:53:39.266003 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:39.281446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e80079-6fa7-4550-ba19-cca32b2dcda4 service neutron] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:39.288427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:39.289198 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:39.289578 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:39.289951 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:39.299741 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:39.301732 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:39.313637 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 829/1638] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:45.803899 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:45.804647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:45.804647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:45.824087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:45.825399 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:45.833333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 810/1639] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:53:46.041463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:46.053089 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f0ef-2ba3-4a39-8412-0e866e327d6e service nova] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:46.058935 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:46.059548 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:46.060106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:46.060572 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:46.071082 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:46.072816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:46.095929 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 830/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:55.818937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=9 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:56.079534 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=18 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:59.600407 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:59.610500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af519f9-e22a-4c16-bf48-949a639d8e61 None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:59.614154 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1efc29-9df6-492c-b7db-9be72c09f15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:59.614770 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1efc29-9df6-492c-b7db-9be72c09f15f service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:59.615050 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1efc29-9df6-492c-b7db-9be72c09f15f service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:59.615319 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1efc29-9df6-492c-b7db-9be72c09f15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:59.624863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1efc29-9df6-492c-b7db-9be72c09f15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:59.626299 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1efc29-9df6-492c-b7db-9be72c09f15f service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:59.637433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 811/1641] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:09.632675 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=6 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:54.120937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:54.199269 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f200738-eb4f-4d4d-8564-0d5bffb084f6 service nova] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:54.205641 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:54.206270 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.206549 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.206823 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.208876 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:54.245875 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:54.247613 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:54.259376 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 831/1642] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:04.254921 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=36 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:05.932789 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:05.933343 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:05.933438 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:05.954231 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] MFA Rules not processed for user `cdf40eba6a514d18b7e1c2b4acda97c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:05.955433 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:05.963389 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 812/1643] 10.222.0.44 () {58 vars in 958 bytes} [Fri Oct 28 09:56:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:06.302060 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:06.323595 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07315e9-dbe5-4719-ac24-dd6b8c72150c service placement] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:06.327318 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f46a8-dcaf-4ed3-9713-53df6d36b6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:06.329046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f46a8-dcaf-4ed3-9713-53df6d36b6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:06.329666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f46a8-dcaf-4ed3-9713-53df6d36b6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:06.329666 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f46a8-dcaf-4ed3-9713-53df6d36b6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:06.338142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f46a8-dcaf-4ed3-9713-53df6d36b6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:06.339604 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f46a8-dcaf-4ed3-9713-53df6d36b6f6 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:06.348658 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 832/1644] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:10.349850 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:10.409278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920c46-2a97-4284-b494-8aeb9635019a None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:10.416048 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b34a8c7d4f242c3a5be691db48cc0d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:10.417010 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:10.417458 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:10.417889 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:10.438018 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:10.440015 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:10.452141 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 813/1645] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:16.344659 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=10 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:19.451072 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:19.451647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:19.451647 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:19.484087 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] MFA Rules not processed for user `b3a1aa24c712441f98b56c9307c93a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:19.485460 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:19.493073 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 833/1646] 10.222.0.44 () {58 vars in 967 bytes} [Fri Oct 28 09:56:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:19.536206 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:19.548500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71ace-fe4b-47fe-864b-bbd045b7e251 service nova] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:19.553711 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc37fd8-10b8-4ade-ad72-94a5a477cf08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3666250d3b11459e84b2e3b672f9ba3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:19.554329 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc37fd8-10b8-4ade-ad72-94a5a477cf08 service swift] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:19.554807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc37fd8-10b8-4ade-ad72-94a5a477cf08 service swift] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:19.555083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc37fd8-10b8-4ade-ad72-94a5a477cf08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:19.564512 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc37fd8-10b8-4ade-ad72-94a5a477cf08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:19.566106 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc37fd8-10b8-4ade-ad72-94a5a477cf08 service swift] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:19.574562 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 814/1647] 10.222.0.44 () {60 vars in 1384 bytes} [Fri Oct 28 09:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:19.938005 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:19.947285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870aba-d785-474f-98d8-b869eafd6697 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:19.951071 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64b12-b5b4-43e6-9974-ff0d71d9a0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:19.951690 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64b12-b5b4-43e6-9974-ff0d71d9a0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:19.951965 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64b12-b5b4-43e6-9974-ff0d71d9a0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:19.952863 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64b12-b5b4-43e6-9974-ff0d71d9a0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:20.024880 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64b12-b5b4-43e6-9974-ff0d71d9a0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:20.026301 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64b12-b5b4-43e6-9974-ff0d71d9a0c7 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:20.045364 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 834/1648] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:24.263103 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5f6c-2cb0-4437-8d90-adc298a7c78f None None] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:24.263651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5f6c-2cb0-4437-8d90-adc298a7c78f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:24.263651 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5f6c-2cb0-4437-8d90-adc298a7c78f None None] PATH_INFO: `/` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:24.265926 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 815/1649] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:56:24.291894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] REQUEST_METHOD: `POST` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:24.292500 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:24.292602 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:24.347775 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.auth.core [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88073) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:24.349023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:24.358097 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 835/1650] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:56:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:24.385892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5f6c-2cb0-4437-8d90-adc298a7c78f None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:24.388117 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-403a5f6c-2cb0-4437-8d90-adc298a7c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:24.409142 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5f6c-2cb0-4437-8d90-adc298a7c78f None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:24.415934 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:24.416670 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:24.417188 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:24.417707 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:24.431203 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:24.433009 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:24.444888 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 816/1651] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:24.752621 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:24.754192 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:24.778083 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5fe1-ce53-4adc-b6cb-8582d7c9b7d3 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:24.782530 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:24.783147 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:24.783427 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:24.783702 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:24.793872 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:24.795315 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:24.806267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 836/1652] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:28.339020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:28.353879 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da6a85-60f8-4c1c-90d1-211cf1599ccb service placement] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:28.359557 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:28.360418 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.361129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.361561 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] PATH_INFO: `/v3/users/95da6f9756ea4e4a848c8a5640b7c85f` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.362854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95da6f9756ea4e4a848c8a5640b7c85f)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:28.364026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: WARNING py.warnings [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:28.364026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: warnings.warn(msg) Oct 28 09:56:28.364026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: Oct 28 09:56:28.365340 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:28.433633 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95da6f9756ea4e4a848c8a5640b7c85f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.453242 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95da6f9756ea4e4a848c8a5640b7c85f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.453893 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95da6f9756ea4e4a848c8a5640b7c85f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.464812 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95da6f9756ea4e4a848c8a5640b7c85f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.473644 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95da6f9756ea4e4a848c8a5640b7c85f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.479580 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 817/1653] 10.222.0.44 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:28 2022] DELETE /identity/v3/users/95da6f9756ea4e4a848c8a5640b7c85f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:28.668196 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:28.681599 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b1b28-626a-4ec0-8a5a-09a204a071f9 service neutron] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:28.741448 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:28.742129 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.742415 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.742687 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] PATH_INFO: `/v3/projects/c8040fa5561746f1b136e4c9984eb5c9` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.743803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8040fa5561746f1b136e4c9984eb5c9)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:28.744855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: WARNING py.warnings [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:28.744855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: warnings.warn(msg) Oct 28 09:56:28.744855 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: Oct 28 09:56:28.746046 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:28.757297 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=100 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:28.808701 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8040fa5561746f1b136e4c9984eb5c9', 'request_id': 'req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.815672 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8040fa5561746f1b136e4c9984eb5c9', 'request_id': 'req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.830868 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8040fa5561746f1b136e4c9984eb5c9', 'request_id': 'req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.869851 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] The token cache is being invalidate because project c8040fa5561746f1b136e4c9984eb5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:28.870143 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.870800 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.872374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 837/1654] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:28 2022] DELETE /identity/v3/projects/c8040fa5561746f1b136e4c9984eb5c9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:28.876838 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:28.878321 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:28.892410 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cb0a0-9174-4545-967c-d40ce8dd6d32 admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:28.952786 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:28.953446 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.953762 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.954042 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] PATH_INFO: `/v3/users/d4a6ecaa988247de8ffdc61124fb87db` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.955256 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a6ecaa988247de8ffdc61124fb87db)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:28.957449 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:28.971062 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:29.010232 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a6ecaa988247de8ffdc61124fb87db'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.025905 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a6ecaa988247de8ffdc61124fb87db'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.026669 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a6ecaa988247de8ffdc61124fb87db'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.034847 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a6ecaa988247de8ffdc61124fb87db'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.042902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a6ecaa988247de8ffdc61124fb87db'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.050023 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 818/1655] 10.222.0.44 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:28 2022] DELETE /identity/v3/users/d4a6ecaa988247de8ffdc61124fb87db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:29.237325 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:29.238837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:29.252327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d5aa-52f6-407a-a752-6ee7568f8c5f admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:29.310051 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:29.310703 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:29.311925 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:29.312212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] PATH_INFO: `/v3/projects/872895ce1c824224999f44785e1f0f1f` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:29.313383 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=872895ce1c824224999f44785e1f0f1f)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:29.315302 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:29.362443 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872895ce1c824224999f44785e1f0f1f', 'request_id': 'req-2833ae7a-f677-42f1-98ca-8596e4b7f9de'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.368002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872895ce1c824224999f44785e1f0f1f', 'request_id': 'req-2833ae7a-f677-42f1-98ca-8596e4b7f9de'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.374713 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872895ce1c824224999f44785e1f0f1f', 'request_id': 'req-2833ae7a-f677-42f1-98ca-8596e4b7f9de'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.387577 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] The token cache is being invalidate because project 872895ce1c824224999f44785e1f0f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:29.387864 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.388507 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.391238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 838/1656] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:29 2022] DELETE /identity/v3/projects/872895ce1c824224999f44785e1f0f1f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:39.045803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:39.384558 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:13.947883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:13.950285 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:14.031820 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193051-cfbc-44d5-b65f-4c7b0a3cf0cc admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:14.083700 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:14.084361 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:14.084643 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:14.084918 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:14.087254 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:14.173671 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:14.175025 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:14.186962 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 819/1657] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:58:15.379780 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:15.382002 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:15.397485 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833ae7a-f677-42f1-98ca-8596e4b7f9de admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:15.402278 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:15.402829 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:15.403111 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:15.403386 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:15.405186 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:15.419333 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:15.420825 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31396a-14db-40d9-b3cb-a06913d2952c service neutron] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:15.432969 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 839/1658] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:24.181885 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=79 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:25.427583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=6 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:28.111493 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.123109 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d36e6-89a8-48b2-be43-13ceaf78fb54 service neutron] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.128001 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828e306d81f64846b2b8f07b3dd1e5a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.128661 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.128937 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.129218 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.130996 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:28.200421 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.201883 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be810-50f0-4608-b20f-50b4a4e7618b service neutron] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.211979 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 820/1659] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:31.276405 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232933-1e14-4e51-b8b5-d9e9247a6f23 None None] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:31.276931 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232933-1e14-4e51-b8b5-d9e9247a6f23 None None] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:31.277039 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232933-1e14-4e51-b8b5-d9e9247a6f23 None None] PATH_INFO: `/` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:31.278402 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 840/1660] 10.222.0.44 () {54 vars in 921 bytes} [Fri Oct 28 09:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:58:31.288684 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] REQUEST_METHOD: `POST` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:31.289227 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:31.289509 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:31.310392 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.auth.core [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] MFA Rules not processed for user `c8de1fbeee81475297d46258d7569b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88074) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:31.311611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:31.398165 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 821/1661] 10.222.0.44 () {58 vars in 1018 bytes} [Fri Oct 28 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:31.611238 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00232933-1e14-4e51-b8b5-d9e9247a6f23 None None] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:31.613463 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-00232933-1e14-4e51-b8b5-d9e9247a6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:31.634608 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00232933-1e14-4e51-b8b5-d9e9247a6f23 None None] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:31.638994 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:31.639617 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] REQUEST_METHOD: `GET` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:31.639902 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:31.640173 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:31.651374 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:31.652550 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:31.664773 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 841/1662] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:58:34.810708 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:34.812267 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:34.827202 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325e9b7-252c-462d-92f3-fd7d48c06a4f None None] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:34.832212 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:34.833583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:34.833583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:34.833583 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] PATH_INFO: `/v3/users/cdf40eba6a514d18b7e1c2b4acda97c7` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:34.848816 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf40eba6a514d18b7e1c2b4acda97c7)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:34.851501 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:34.899499 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf40eba6a514d18b7e1c2b4acda97c7'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:34.911178 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf40eba6a514d18b7e1c2b4acda97c7'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:34.911854 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf40eba6a514d18b7e1c2b4acda97c7'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:34.919150 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf40eba6a514d18b7e1c2b4acda97c7'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:34.920953 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:34.929537 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf40eba6a514d18b7e1c2b4acda97c7'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:34.936305 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 822/1663] 10.222.0.44 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:34 2022] DELETE /identity/v3/users/cdf40eba6a514d18b7e1c2b4acda97c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:35.136314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:35.148737 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18564d-89b4-410e-9318-6c1d4562467e service placement] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:35.220807 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:35.221471 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:35.221756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:35.222030 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] PATH_INFO: `/v3/projects/8642f357111144039791e597c6668f7b` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:35.235029 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8642f357111144039791e597c6668f7b)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:35.237133 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:35.294894 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8642f357111144039791e597c6668f7b', 'request_id': 'req-f88343e0-dcf5-4287-9212-c6131c6ef02f'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.301685 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8642f357111144039791e597c6668f7b', 'request_id': 'req-f88343e0-dcf5-4287-9212-c6131c6ef02f'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.310077 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8642f357111144039791e597c6668f7b', 'request_id': 'req-f88343e0-dcf5-4287-9212-c6131c6ef02f'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.325107 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] The token cache is being invalidate because project 8642f357111144039791e597c6668f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:35.325394 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.326070 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.327611 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 842/1664] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:35 2022] DELETE /identity/v3/projects/8642f357111144039791e597c6668f7b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:35.332322 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:35.333961 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:35.348734 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a62c3-39de-46aa-92c7-675e8430f4c1 admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:35.419751 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:35.420338 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:35.420622 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:35.420898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] PATH_INFO: `/v3/users/3f278ffde64c4e598f30e24da90dc30f` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:35.436219 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f278ffde64c4e598f30e24da90dc30f)` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:35.438237 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:35.490503 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f278ffde64c4e598f30e24da90dc30f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.503546 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f278ffde64c4e598f30e24da90dc30f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.504457 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f278ffde64c4e598f30e24da90dc30f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.512482 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f278ffde64c4e598f30e24da90dc30f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.520720 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.notifications [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f278ffde64c4e598f30e24da90dc30f'} {{(pid=88074) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.528938 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 823/1665] 10.222.0.44 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:35 2022] DELETE /identity/v3/users/3f278ffde64c4e598f30e24da90dc30f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:35.726591 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Authenticating user token {{(pid=88073) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:35.728008 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.fernet_utils [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88073) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:35.740947 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88343e0-dcf5-4287-9212-c6131c6ef02f admin admin] Validating token access rules against request {{(pid=88073) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:35.810995 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094fba2382e149f9b3e5ba2c3c144f8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a3fbfe9961948fb97255019ee76e43a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88073) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:35.811631 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:35.811908 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:35.812180 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] PATH_INFO: `/v3/projects/5ca33e7fd59e4b3899a3a03a1502a8fc` {{(pid=88073) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:35.824898 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca33e7fd59e4b3899a3a03a1502a8fc)` {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:35.826837 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] RBAC: Authorization granted {{(pid=88073) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:35.828387 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:35.881295 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca33e7fd59e4b3899a3a03a1502a8fc', 'request_id': 'req-927c71ca-8610-4760-9720-16d611babe12'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.888027 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca33e7fd59e4b3899a3a03a1502a8fc', 'request_id': 'req-927c71ca-8610-4760-9720-16d611babe12'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.895020 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca33e7fd59e4b3899a3a03a1502a8fc', 'request_id': 'req-927c71ca-8610-4760-9720-16d611babe12'} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.910137 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] The token cache is being invalidate because project 5ca33e7fd59e4b3899a3a03a1502a8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88073) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:35.910481 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.911228 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG keystone.notifications [None req-927c71ca-8610-4760-9720-16d611babe12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88073) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:35.912945 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: [pid: 88073|app: 0|req: 843/1666] 10.222.0.44 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:35 2022] DELETE /identity/v3/projects/5ca33e7fd59e4b3899a3a03a1502a8fc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:58:45.524523 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=60 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:45.906462 dv-osbrick-zed-4-iscsi devstack@keystone.service[88073]: DEBUG dbcounter [-] [88073] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:57.952327 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Authenticating user token {{(pid=88074) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:57.953759 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:58.023892 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebd45b-1ff1-4414-86f3-aa477d0b21db admin admin] Validating token access rules against request {{(pid=88074) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:58.094803 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8de1fbeee81475297d46258d7569b02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '862360b634994703825014c6d7c129f0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88074) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:58.095472 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] REQUEST_METHOD: `GET` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:58.095756 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] SCRIPT_NAME: `/identity` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:58.096026 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88074) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:58.097791 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.fernet_utils [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88074) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:58.108746 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:58.110314 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184bbe-d6ba-4b10-bdde-41a5892e0575 service placement] RBAC: Authorization granted {{(pid=88074) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:58.119849 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: [pid: 88074|app: 0|req: 824/1667] 10.222.0.44 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:08.115858 dv-osbrick-zed-4-iscsi devstack@keystone.service[88074]: DEBUG dbcounter [-] [88074] Writing DB stats keystone:SELECT=58 {{(pid=88074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}